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The  Making 


OF  A 

Professional 


Society 


ORS,  as  a  profes¬ 
sional  society,  has 
continuously  devoted 
its  growth  to  the  needs 
and  demands  of  its 
members.  This  results 
in  a  persistent,  adaptable  evolution 
to  fine  tune  itself  to  the  best  interest 
of  our  membership,  while  maintain¬ 
ing  consciousness  of  the  fiscal  envi¬ 
ronment.  As  defined  by  the  multiple 
contributors  to  Wikipedia  and  other 
scholarly  articles,  a  professional  as¬ 
sociation  (also  called  a  professional 
body,  professional  organization,  or 
professional  society)  is  usually  a  non¬ 
profit  organization  seeking  to  further 
a  particular  profession,  the  interests 
of  individuals  engaged  in  that  profes¬ 
sion,  and  the  public  interest.  The 
roles  of  these  professional  associa¬ 
tions  have  been  variously  defined:  “A 
group  of  people  in  a  learned  occupa¬ 
tion  who  are  entrusted 
with  maintaining 
control  or  oversight 
of  the  legitimate 
practice  of  the 
occupation” 

(Harvey,  2004); 
also  a  body 
acting  “to 
safeguard  the 
public  inter¬ 
est;”  (Harvey 
et  al.,  1995); 


professional  society  offers  individu¬ 
als  the  opportunity  to  support  or  be 
actively  involved  in  research,  com¬ 
munications,  and  programs  in  their 
field.  As  such,  MORS  focuses  its 
activities  on  empowering  operations 
research  professionals  like  you  to 
obtain  individual 
benefits  from 
the  commu¬ 
nity,  and 
at  the 
same 


organizations  which  “represent  the 
interest  of  the  professional  practitio¬ 
ners,”  and  so  “act  to  maintain  their 
own  privileged  and  powerful  position 
as  a  controlling  body”  (Harvey  et  al., 
1995).  The  mission  of  the  Military 
Operations  Research  Society  is  to 
enhance  the  quality  of  analysis  ad¬ 
dressing  real-world  national  security 
interests  through  the  advancement  of 
the  operations  research  profession. 


Membership  Value 

In  addition  to  tangible 
benefits  that  members 
find  of  value,  such 
as  access  to  profes¬ 
sional  publications  and 
discounted  cost  to  at¬ 
tend  professional  and 
education  meetings, 
and  other  events, 
membership  in  a 
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time  provide  you  with  the  oppor¬ 
tunity  to  contribute  to  the  national 
security  analytic  community  at  large. 

Some  of  the  outlets  available  to 
members  to  learn  and  share  include 
our  meetings  and  conferences, 
which  provide  the  opportunity  to 
participate  in  and  attend  presenta¬ 
tions  on  research  in  our  discipline, 
and  across  other  disciplines  that  ap¬ 
ply  our  operations  research  toolset. 
This  interdisciplinary  interaction  has 
evolved  in  recent  years,  providing 
our  members  and  others  disciplines 
an  open  forum  from 
which  we  contin¬ 
ue  to  enhance 
our  awareness 
on  the  depth 
and  breadth  of 
the  applicability 
of  our  skills. 

Just  recently, 
MORS  held  its 
third  Industry 
Showcase  on 


“Developing  the  Analytical  Work¬ 
force:  Shared  Perspectives  between 
Government  and  Industry,”  where 
we  engaged  in  a  very  informa¬ 
tive  program  designed  to  address 
upcoming  challenges  in  workforce 
development  and  human  capital 
investments.  On  the  surface,  these 
do  not  sound  like  topics  affect¬ 
ing  military  operations  research  or 
national  security.  However,  when 
we  take  a  closer  look,  we  real¬ 
ize  their  impacts.  The  discussions 
focused  on  two  perspectives:  First, 
the  operations  researcher’s  contri¬ 
bution  in  analyzing  and  providing 
insights  to  improve  the  corporate 
and  government  workforce;  and 
second,  the  need  to  better  under¬ 
stand  and  suggest  ways  to  enhance 
the  development  and  training  of 
operations  researchers  to  meet  the 
analytical  demands  of  government 
and  industry.  This  gathering  provided 
a  series  of  distinguished  speakers, 
panels  of  experts,  discussions,  ex¬ 
hibits,  demonstrations,  and  informal 
interactions,  presenting  government, 
industry,  and  academics  with  an 
opportunity  to  learn  from  each  other 
and  share  experiences  in  a  nonattri- 
butional  multifaceted  forum. 

Our  focus  this  year  on  “Growth 
through  Professional  Development 
and  Continuing  Education”  high¬ 
lights  the  need  to  stay  on  the  lead¬ 
ing  edge  of  our  profession,  allowing 
us  to  enhance  the  contribution  to 
others,  as  the  demand  for  analytical¬ 
ly  rigorous  approaches  and  results 
continues  to  increase.  I  would  like  to 
highlight  one  of  our  premier  events 
this  year,  the  Education  and  Profes¬ 
sional  Development  (EPD)  Collo¬ 


quium,  to  be  held  at  George  Mason 
University.  The  EPD  Colloquium  is 
a  yearly  event  designed  to  bring 
together  students,  junior  analysts, 
and  senior  professionals  to  provide 
mentoring  and  professional  devel¬ 
opment  opportunities.  The  steady 
growth  of  our  society  benefits 
tremendously  from  the  exchanges 
that  occur  during  this  event  in  which 
we  also  provide  outreach  activities; 
offer  a  job  fair  where  students  can 
explore  potential  future  employment 
opportunities;  provide  presenta¬ 
tions  of  published  reports,  surveys, 
professional  guides,  certification  op¬ 
portunities,  and  other  resources  for 
operations  research  departments, 
authors,  graduate  and  undergradu¬ 
ate  students,  and  the  professional 
community  as  a  whole.  This  is  a 
must-attend  event  every  year. 

As  with  many  professional  bodies, 
MORS  is  involved  and  committed 
to  the  development  and  monitoring 
of  professional  education  programs, 
and  the  updating  of  skills.  Our  Con¬ 
tinuing  Education  Committee  is  con¬ 
centrating  its  efforts  in  the  develop¬ 
ment  of  courses,  tutorials,  programs 
leading  to  certification,  and  other 
ways  to  enhance  or  refresh  our  skills 
in  diverse  areas  of  our  profession. 
We  are  not  only  focusing  on  the  hard 
skills  required  to  impart  analytical 
rigor  to  our  work,  but  also  on  the 
soft  skills,  critical  thinking,  studies 
management,  effective  presenta¬ 
tion  of  results,  and  others,  that  can 
enhance  the  quality  and  credibility 
of  what  we  do.  Stay  tuned  to  future 
courses  and  tutorials  that  will  be 
offered  as  stand-alone  events,  or  as 
part  of  our  meetings. 
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As  our  premier  annual  event,  please 
remember  to  lock  in  the  dates  for 
the  83rd  MORS  Symposium,  which 
will  offer  the  finest  opportunities 
for  professional  collaboration  and 
networking.  This  year  our  signature 
event  is  scheduled  for  June  22-25, 
201 5  at  the  DoD  Mark  Center  in 
Alexandria,  Virginia.  We  have  re¬ 
ceived  a  tremendous  set  of  terrific 
abstracts  taking  advantage  of  the 
enhanced  opportunities  this  year  to 
present  your  work  at  this  event.  De¬ 
tails  on  program  specifics  are  avail¬ 
able  on  the  MORS  website:  www. 
mors.org/Events/Symposium/83rd- 
Symposium. 

Moving  Ahead: 

Continuing  Evolution 

With  the  83rd  Symposium  we  will 
kick  off  our  50th  year,  as  a  continu¬ 
ously  evolving  society,  with  a  range 
of  activities  that  I  am  sure  will  be  of 
great  interest,  as  we  observe  this 
major  milestone.  As  more  rigorous 
analysis  is  required  to  prepare  and 
defend  the  shaping  of  our  National 
Security  interests,  it  is  imperative 
that  we  continue  to  concentrate 
some  energy  on  maintaining  the 
growth  of  our  discipline  and  the 
skills  of  our  national  security  analytic 
professionals,  both  in  government 
and  nongovernment  organizations. 
One  way  to  achieve  this  is  by  sup¬ 
porting  existing  continuing  education 
opportunities,  and  developing  new 
ones,  targeting  the  maintenance  and 
enhancement  of  the  technical  com¬ 
petence  of  our  members. 


With  an  in-person  and  a  virtual  com¬ 
ponent,  the  83rd  Symposium  will 
allow  analysts  across  the  national 
security  community  to  share  their 
work  and  collaborate  with  diverse 
and  talented  professionals.  The 
MORS  Symposium  is  a  great  place 
to  not  only  show  off  completed 
work,  but  also  discuss  new  efforts  in 
their  early  stages.  Colleagues  with 
different  backgrounds  and  experi¬ 
ences  can  often  help  each  other 
think  through  the  formulation  of  their 
problem  and  better  assess  alternate 
approaches  and  methods. 

I  would  also  like  to  take  this  op¬ 
portunity  to  invite  you  to  navigate 
through  the  new  MORS  website 
and  membership  management 
system.  Many  of  you  have  already 
experienced  the  new  site  since  we 
launched  it  in  early  December.  You 
might  have  noticed  not  only  a  new 
look  and  feel,  but  also  a  tremendous 
enrichment  in  content  and  capa¬ 
bility.  With  these  new  initiatives, 
MORS  is  significantly  enhancing  and 
improving  services  to  our  members 
and  the  OR  community.  Please  look 
around  the  site  and  explore  the 
MORS  resource  center,  an  all-new 
initiative  to  bring  our  vast  library  of 
reports,  out-briefs,  oral  histories, 
articles,  publications  and  other 
important  documents  to  you  with 
full,  in-depth  text  search  capability. 
As  a  user  of  this  site  you  will  find 
the  “My  MORS”  section  with  your 
profile  and  purchase  history  easy  to 
navigate.  Some  additional  features 
and  enhancements  are  still  being 


rolled  out  to  better  serve  you.  As 
an  example:  your  papers,  presenta¬ 
tions,  and  published  articles,  as  well 
as  MORS  community  participation 
in  our  volunteer  leadership  positions 
for  meetings,  the  annual  sympo¬ 
sium,  working  groups,  communi¬ 
ties  of  practice,  and  others,  will  be 
linked  to  your  permanent  profile  in 
“My  MORS”  for  easy  access  in  the 
future.  Stay  tuned. 

Your  MORS  Board  of  Directors  has 
been  working  very  hard,  listening  to 
your  needs,  creating  new  value  to 
your  membership,  and  supporting 
the  continuing  evolution  of  our  orga¬ 
nization.  We  all  are  very  excited  to 
bring  you  these  membership  offer¬ 
ings.  We  are  here  to  serve  you  and 
welcome  your  comments  in  the  best 
interest  of  our  discipline,  the  Nation¬ 
al  Security  analytic  community,  and 
supporting  our  mission  to  enhance 
the  quality  of  analysis  addressing 
real-world  national  security  interests 
through  the  advancement  of  the  OR 
profession.  We  thank  you  for  being 
an  integral  part  of  our  efforts. 
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INFORMS 

As  I  mentioned  in  the  last  issue,  I  want  to  outline  some  of  the  happenings  at  the 
INFORMS  Annual  Meeting  held  in  San  Francisco  in  November  and  I  will  conclude 
with  some  information  about  operations  research  within  the  Army. 


INFORMS  2014  was  an  exciting 
meeting  with  more  than  5,000 
participants,  and  hopefully  this 
synopsis  will  inspire  even  more 
people  from  MAS  and  the  mili¬ 
tary  OR  community  to  attend, 
present,  chair,  and  participate  in  the 
November  2015  annual  meeting  in 
Philadelphia.  The  best  part  of  being 
at  the  INFORMS  meeting  is  getting 
to  know  your  community— in  this 
case  the  Military  Applications  Soci¬ 
ety  (MAS).  Whether  it’s  the  recep¬ 
tions,  presentations,  panel  sessions, 
tutorials,  or  business  meetings, 
there  is  always  time  to  meet  new 
people,  reconnect  with  friends  and 
colleagues,  and  share  ideas.  The 
career  center  hiring  event  showed 
that  cyber,  big  data,  and  network 
modeling  promise  to  be  big  play¬ 
ers  in  the  future  of  OR.  I  personally 
developed  many  new  contacts  and 
learned  valuable  up-to-date  infor¬ 
mation  from  the  conference  and  am 
already  preparing  myself  for  the  next 
annual  conference. 

William  Fox  of  the  Naval  Postgradu¬ 
ate  School  and  past  president  of 
MAS  chaired  the  overall  MAS  ses¬ 
sions  with  help  from  many  session 
chairs,  speakers,  and  panelists.  I 


thank  all  who  participated  and  men¬ 
tion  below  some  presenters  and 
participants.  My  apologies  to  those 
that  I  have  missed. 

Richard  Deckro,  Air  Force  Institute 
of  Technology,  chaired  a  session 
on  analysis  in  support  of  national 
security.  Some  of  the  speakers  in 
his  session  were  Matthew  Robbins, 
Sean  Keneally,  Brian  Lunday,  Jas¬ 
mine  Morgan,  Michael  J.  Kwinn,  Jr., 
and  David  Smalenberger. 

Dean  Hartley,  Hartley  Consulting, 
chaired  two  sessions  on  DIM  E/PM  E- 
Sll.  His  speakers  included  Jeff  Apple- 
get,  Charlie  Graham,  Karen  Guttieri, 
John  Hummel,  Paul  Lewis,  Ignacio 
Martinez-Moyana,  and  Philip  Fellman. 

Greg  Parlier,  MAS  past  president, 
presented  tutorials  on  “Predictive 
Analytics,”  “Management  Innova¬ 
tion  to  Transform  the  Department 
of  Defense  Logistics  Enterprise,” 
and  a  special  “MAS  Session  on  the 
State  of  Operations  Research  in 
the  US  Military:  A  75th  Anniversary 
Perspective.”  He  also  chaired  a 
joint  MAS/DAS  session  on  military 
decision  analysis  applications.  His 
speakers  included  Thomas  Wil- 


lemain.  Greg’s  significant  historical 
presentation,  “The  State  of  Opera¬ 
tions  Research  in  the  US  Military: 

A  75th  Anniversary  Perspective,” 
was  summarized  by,  “perspectives 
on  the  past,  present,  and  future  of 
operations  research  in  the  US  De¬ 
partment  of  Defense  with  emphasis 
on  the  Army.  The  need  for  a  critical 
review  is  argued,  and  a  framework 
for  a  comprehensive  assessment  is 
developed.  Enduring  principles  are 
suggested,  and  new  concepts  are 
presented,  including  both  strategic 
and  transformational  analytics.” 

Greg  Parnell,  University  of  Arkansas, 
chaired  a  session  on  military  deci¬ 
sion  analysis  applications. 

William  Fox,  Naval  Postgraduate 
School,  chaired  two  sessions  on 
mathematical  modeling  and  opera¬ 
tions  research  in  military  decision 
making.  Presenting  in  these  ses¬ 
sions  were  Tiffany  Crosby,  Daniel 
Stimpson,  Rajesh  Ganesan,  and 
David  Marlow,  Mike  Teter,  Michael 
Jaye,  and  Robert  Burks. 

Nathaniel  Bastian,  PhD  Student 
at  Pennsylvania  State  University, 
chaired  a  session  on  advances  in 
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speakers  in  these  sessions  included 
Andrew  Romich,  George  Lan,  J. 
Cole  Smith,  Emily  Craparo,  Mumtaz 
Karatas,  Carl  Parson,  Darryl  Ahner, 
Cleber  Almeida  De  Oliveira,  Daniel 
Schroeder,  Alvaro  Maggiar,  Irina  Do- 
linskaya,  Paul  Scerri,  Bob  Jacobs, 
Monali  Malvankar,  Siddhartha  Meh¬ 
ta,  Eduardo  Pasiliao,  Mike  Moskal, 
Rajan  Batta,  Aaron  Williams,  Azar 
Sadeghnejad  Barkousa,  Moises  Su- 
dit,  Rajan  Batta,  Hector  Ortiz-Pena, 
Moises  Sudit,  Mark  Karwan,  Luca 
Bertuccelli,  Francesco  Leonardi, 
Jeffrey  Peters,  Amit  Surana,  Mi¬ 
chael  Couche,  Tae  Bo  Jeon,  David 
Casbeer,  Michael  Atkinson,  Moshe 
Kress,  Yan  Xia,  Rajan  Batta,  Rakesh 
Nagi,  Paul  Scerri,  Joe  Mola,  Elan 
Freedy,  and  Amos  Freedy. 


Christopher  Smith,  Direc¬ 
tor,  TRAC-Monterey, 
chaired  a  joint 


military  healthcare  operations  re¬ 
search  with  many  speakers  includ¬ 
ing  Lawrence  Fulton,  Pat  McMurry, 
Paul  Griffin,  Tahir  Ekin,  Ozan  Ko- 
cadagli,  Benjamin  Grannan,  Laura 
McLay,  Nolan  Roggenkamp,  and 
Temi  Ayeni. 


Aaron  Burciaga,  Accenture,  chaired 
three  sessions:  “Analytics  for  New 
Efficiencies:  Quality  and  Lifecycle 
Management  in  the  DoD,”  “Analyt¬ 
ics  for  Surviving  Austerity:  Doing 
More  with  Less,”  and  “Analytics 
for  the  Tactical  Edge:  Better  Busi¬ 
ness  through  Operations  Research 
in  the  DoD.”  The  presenters  were 
Rodrigo  Hernandez,  Natalie  Scala, 
Paul  Goethals,  Harpreet  Toor,  Maro 
Enoka,  Randal  Allen,  Don  Hanks, 
and  Will  Donovan. 


Michael  Hirsch,  ISEATEK,  chaired 
sessions  on  sensors  and  weapons 
and  sessions  on  mission  planning 
and  search  theory  along  with  Chase 
Murray,  Auburn  University,  on 
mission  planning.  The 
outstanding 


session:  Social  Media  in  Disaster  Re¬ 
sponse,”  and  “Diplomacy,  Sentiment, 
&  Social  Network  Analysis  Using 
Social  Media.” 


Jun  Zhuang,  University  at  Buf¬ 
falo,  chaired  “Decision  Analysis: 
Game  Theory,  Decision  Analysis, 
and  Homeland  Security.”  Speak¬ 
ers  included  Thanh  Nguyen,  Milind 
Tambe,  Gary  Gaukler,  Cen  Song, 
and  Elizabeth  Paulson. 


Harrison  Schramm,  Office  of  the 
Chief  of  Naval  Operations,  chaired 
a  session  on  “New  Voices  in  Mili¬ 
tary  Operations  Research,”  with 
presentations  by  Robert  Lantz, 
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Jennifer  Stave,  Alonzo  Barnett,  and 
Jon  Roginski. 


In  addition  to  the  MAS-sponsored 
presentations,  the  INFORMS  confer¬ 
ence  gave  attendees  many  wonderful 
opportunities  for  learning  and  sharing. 

I  particularly  enjoyed  the  Philip  Mc¬ 
Cord  Morse  Lecture  on  “Statistics  and 
Machine  Learning  via  a  Modern  Opti¬ 
mization  Lens”  by  Dimitris  Bertsimas, 
professor  of  operations  research  and 
statistics  at  Massachusetts  Institute  of 
Technology.  It  is  significant  that  over 
“the  last  twenty-five  years  (1 990- 
2014),  algorithmic  advances  in  integer 
optimization  combined  with  hardware 
improvements  have  resulted  in  an 
astonishing  200  billion  factor  speedup 
in  solving  MIO  problems.”  The  pace 
of  our  world  is  increasing  dramatically 
and  as  OR  analysts,  we  have  our  work 
cut  out  for  us  to  keep  up. 


In  San  Francisco,  our  executive 
council  meeting  confirmed  the  plan 
to  have  our  dues  remain  at  $25  per 
year  with  Phalanx  provided  online 
with  the  membership.  The  hard 
opy  of  Phalanx  is  an  ad¬ 
ditional  $36  per  year 
for  US  mailing 


$55 


and 


please  send  your  ideas  to  me  at 
David.Arney@usma.edu. 

The  general  membership  meeting  was 
well  attended  and  we  were  pleased  to 
present  the  following  awards: 

•  Steinhardt  Prize:  Dr.  Ervin  Ka- 
pos,  who  served  with  the  Office 
of  Naval  Research  and  the  De¬ 
partment  of  Homeland  Security. 

•  Koopman  Prize:  Gerald  Brown, 
Matthew  Carlyle,  and  Robert  Dell 
(Naval  Postgraduate  School)  and 
John  Brau,  Jr  (USTRANSCOM), 
for  their  article  “Optimizing  Intra¬ 
theater  Military  Airlift  in  Iraq  and 
Afghanistan”  that  appeared  in 
Military  Operations  Research. 

•  Bonder  Award:  Jason  South¬ 
erland,  PhD  student  at  George 
Mason. 

•  Outstanding  Service:  Walt  De- 
Grange  (outgoing  secretary  of 
MAS)  and  William  Fox  (outgoing 
president  of  MAS) 

Consider  participating  in  these  up¬ 
coming  2015  meetings: 


for  international  mailing.  The  meet¬ 
ing  also  gave  us  resolve  to  use 
INFORMS  Connect  (online  system) 
to  share  more  information.  We 
can  all  start  this  initiative  by  going 
online  and  sharing  information  and 
performing  collaboration.  We  also 
discussed  the  possibility  for  new 
awards  in  education  and  mentor¬ 
ing,  ways  to  connect  with  MORS, 
especially  on  education  issues,  and 
the  future  of  the  Certified  Analyt¬ 
ics  Professional  (CAP)  Exam  for 
MAS  members.  CAP  is  offered  by 
INFORMS  as  the  profession’s  first 
general  analytics  certification  exam 
and  can  help  improve  analysts’  job 
performance  by  stressing  con¬ 
tinuing  professional  development 
and  building  competence  in  the 
principles  and  practice  of  analyt¬ 
ics.  To  obtain  the  certification,  an 
eligible  person  must  pass  the  exam 
and  adhere  to  the  code  of  ethics. 
Eligibility  requirements  include  five 
years  of  analytics  work-related 
experience  for  a  BA/BS  holder  in 
a  related  area  or  three  years  of 
analytics  work-related  experience 
for  a  MA/MS  (or  higher)  holder  in  a 
related  area  and  verification  of  soft 
skills  in  business  as  evaluated  by 
the  employer.  If  you  have  any  sug¬ 
gestions  for  topics  for  the  MAS 
Board  to  consider, 
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•  201 5  INFORMS  Conference  on 
Business  Analytics  &  Operations 
Research,  April  12-14,  at  the 
Hyatt  Regency  Resort  &  Spa, 
Huntington  Beach,  California. 

•  2015  CORS/INFORMS  Interna¬ 
tional  Conference,  June  14-17, 
at  the  Le  Centre  Sheraton  Hotel, 
Montreal.  Greg  Parlierwill  chair 
the  MAS  session. 

•  INFORMS  Healthcare  Conference, 
July  29-31  in  Nashville,  Tennessee. 

•  INFORMS  Annual  Meeting,  No¬ 
vember  1-4  at  the  Pennsylvania 
Convention  Center  and  Marriott 
in  Philadelphia. 

OR  in  the  Military  Today 

The  military  OR  community  contin¬ 
ues  to  expand  into  many  of  the  hot 
research  areas  within  the  field  of  OR. 
The  big  data  challenges  and  ques¬ 
tions  emerging  from  data  and  net¬ 
work  sciences  have  interesting  ap¬ 
plications  both  within  the  generating 
and  operation  forces  of  the  services. 
The  Army  has  placed  analysts  within 
the  Army  medical  community  as  well 
as  the  Army  cyber  community  to  at¬ 
tempt  to  exploit  their  large  datasets 
and  to  provide  the  decision  support 


these  areas  so  desperately  need. 
Once  an  analyst  is  placed  within 
an  organization  and  benefits  from 
OR  contributions,  there  is  always  a 
request  from  the  organization  for  ad¬ 
ditional  analysts. 

The  military  is  also  finding  that  the 
success  of  OR  analysts  in  operations 
and  campaign  planning  and  assess¬ 
ment  as  well  as  programming  and 
budget  analysis  does  not  convey 
the  full  breadth  of  possible  military 
benefits  of  OR.  Some  of  the  military’s 
senior  leaders  do  not  appreciate  the 
variety  of  research  that  well-educated 
OR  analysts  are  prepared  to  perform. 
The  cyber  organizations  have  large 
quantities  of  data  to  be  analyzed  and 
cyber  modeling  presents  a  clear  big 
data  challenge.  However,  we  have 
to  continue  to  work  the  connection 
between  the  big  data  and  data  sci¬ 
ence  problems  and  the  military  OR 
community.  The  analysts  that  the 
Army  has  assigned  to  ARCYBER, 
working  closely  with  the  Center  for 
Army  Analysis,  have  been  working  on 
models  for  cyber  training  pipelines, 
but  this  is  only  the  beginning  of  the 
work  that  can  be  done.  Clearly,  not 


all  analysts  are  trained  to  perform 
all  types  of  analysis,  but  as  a  com¬ 
munity,  the  Army  OR  analysts  have 
expertise  that  can  assist  in  all  areas 
of  OR.  The  Army  OR  leaders  and 
managers  continue  to  encourage  the 
collaboration  that  is  facilitated  by 
conference  attendance  to  share  the 
wealth  of  experience  within  the  Army 
OR  community. 

The  world  of  OR  continues  to  move 
at  warp  speed  as  the  information, 
techniques,  issues,  and  important 
questions  change  and  shift  in  our 
society.  This  rapid  pace  of  change 
it’s  so  valuable  for  analysts  to  at¬ 
tend  conferences  like  the  INFORMS 
annual  meeting  and  learn  first-hand 
about  some  of  the  changes  and  meet 
many  of  the  people  who  are  produc¬ 
ing  these  changes.  I  hope  to  see 
many  of  you  at  meetings  and  confer¬ 
ences  in  the  future. 

Acknowledgments 
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201 5  MORS  Fellows 

Simon  R.  Goerger,  MORS  Membership  Committee  Chair 


Since  1989,  the  MORS  Board 
of  Directors  (BoD)  has  annu¬ 
ally  recognized  outstanding 
members  of  the  Society  for 
significant,  long-term  con¬ 
tributions  to  the  Society  and 
inducted  these  individuals  into  the 
ranks  of  the  MORS  Fellows.  This  year, 
MORS  is  pleased  to  recognize  four 
members  of  our  Society,  selected  in 
December,  as  MORS  Fellows:  Mr. 
“Trip”  Barber,  Dr.  John  R.  Hummel, 

Ms.  Lana  E.  McGlynn,  and  Mr.  Ter¬ 
rance  J.  “Terry”  McKearney. 

These  four  individuals  have  contrib¬ 
uted  numerous  hours  of  volunteer 
service  to  the  Society  in  a  multitude 
of  ways  and  have  provided  last¬ 
ing  positive  contributions  that  will 
continue  to  enhance  the  rolls  and 
effects  of  MORS  for  its  membership 
and  the  Nation’s  security.  They  join 
the  71  members  of  our  community 
previously  recognized  with  this  honor 
(http://www.mors.org/Home/About- 
MORS/Fellows). 


Mr.  “Trip”  Bar¬ 
ber  has  been  a 
member  of  MORS 
since  2002, 
making  him  the 
Junior  Fellow  of 
the  2015  Fel¬ 
lows’  Class.  Mr.  Barber  has  served  as 
the  Navy  MORS  sponsor  for  over  a 
decade  and  has  been  a  vocal  advo¬ 
cate  for  the  Society.  He  was  instru¬ 
mental  in  arranging  the  2007  and 
201 1  MORS  Symposium  at  the  Naval 
Postgraduate  School  and  the  Naval 
Academy  as  well  as  helping  to  build 
the  Navy’s  current  operations  analysis 


community  by  encouraging  Navy  ana¬ 
lysts  to  present  their  work  at  MORS  at 
least  once  a  tour. 

Dr.  John  R.  Hum¬ 
mel  has  been  a 
MORS  member 
since  2000.  He 
has  served  the 
Society  in  12 
working  group/ 
composite  group  leadership  posi¬ 
tions,  co-chair  for  two  special  meet¬ 
ings,  and  as  the  MORS  Symposium 
program  co-chair,  chair,  and  advisor. 
He  has  also  served  as  an  elected 
and  advisory  member  of  the  Board 
of  Directors  (BoD).  John  was  also 
essential  in  establishing  the  De¬ 
partment  of  Energy  (DoE)  Argonne 
National  Laboratory  (ANL)  as  a  major 
participant  in  MORS  and  as  a  found¬ 
ing  member  of  the  MORS  Industry 
and  Institutional  Partnership  program. 
John  continues  to  serve  the  society 
as  an  advisory  director  to  the  MORS 
Board  and  contributes  as  a  member 
on  several  of  its  committees. 


A  member  of 
MORS  since  1989, 

Ms.  Lana  E.  Mc¬ 
Glynn  has  served 
as  the  Army 
sponsor’s  rep¬ 
resentative  from 
1997  until  2000,  a  MORS  registration 
volunteer  at  MORS  symposia  for  over 
24  years,  and  as  a  VIP  coordinator 
at  numerous  MORS  symposia.  She 
was  an  elected  member  of  the  MORS 
board  from  2000-2004  and  an  advi¬ 
sory  director  from  2004-2014.  She 
has  chaired  three  BoD  committees, 


participated  as  a  member  of  eight 
BoD  committees,  and  has  been  on  the 
organizing  committee  for  four  MORS 
workshops  or  minisymposiums. 


Mr.  Terrance  J. 

“Terry”  McKear¬ 
ney  has  been 
a  member  of 
MORS  since 
1995.  Over  the 
nearly  two  de¬ 
cades  of  his  service  to  the  Society, 
Terry  has  served  on  six  WG/CG  lead¬ 
ership  positions;  a  synthesis  group 
chair;  a  workshop  co-chair;  and  the 
MORS  Symposium  program  co-chair, 
chair,  and  advisor.  He  served  as  an 
elected  member  of  the  MORS  board 
from  2006  until  2012.  While  on  the 
MORS  Board,  Terry  served  as  the 
MORS  Vice  President  for  Finance 
and  Management  and  as  the  MORS 
President  201 0-201 1 .  As  well  as  be¬ 
ing  a  MORS  advisory  director,  Terry 
continues  to  serve  the  Society  as  the 
editor  of  the  Phalanx. 

Again  we  thank  these  outstanding 
volunteers  and  operations  research 
professionals  of  our  Society  and 
welcome  them  as  the  newest  MORS 
Fellows. 
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to  Serve  Our  Members 

Susan  K.  Reardon,  MORS  Chief  Executive  Officer,  susan@mors.org 


n  December  1 , 2014  MORS 
launched  a  new  technol¬ 
ogy  and  communications 
initiative,  which  includes 
a  new  website  and  mem¬ 
ber  management  system. 
The  system  is  called  NOAH  and  was 
developed  by  JL  Systems  of  Annan- 
dale,  Virginia.  NOAH  provides  a  more 
effective  and  technically  up-to-date 
platform  for  communications  with  our 
members  and  improves  online  access 
for  members  to  MORS  information  and 
resources.  To  achieve  this,  the  MORS 
website  (www.mors.org)  was  rede¬ 
signed  and  reorganized  and  is  now 
a  responsive  site  that  automatically 
adjusts  to  the  platform  you  are  using. 

The  NOAH  system  replaced  five 
independent  systems,  saving  MORS 
money  and  saving  you  passwords  to 
memorize!  The  website  is  fully  inte¬ 
grated  with  the  membership  system. 
When  you  sign  on  as  a  member  you 
will  see  additional  menu  items  ap¬ 
pear  that  give  you  access  to  “member 
only”  pages  and  features.  The  “My 
MORS”  page  is  your  personal  record 
of  your  MORS  purchases,  commit¬ 
tee,  and  working  group  membership, 
subscriptions,  and  areas  of  interest. 

As  we  build  the  system,  it  will  include 
your  submissions  for  symposium  and 
special  meeting  presentations,  articles, 
and  more. 


oral  histories,  articles,  publications, 
and  other  important  documents  to 
you  with  full  text  search  capability.  Still 
under  development  and  coming  soon 
are  blogs,  forums,  and  further  devel¬ 
opment  of  our  system  to  be  a  fully 
interactive  online  platform  for  commu¬ 
nications  and  collaboration.  MORS  is 
here  to  serve  our  members  and  com¬ 
munity  and  we  are  striving  to  do  that 
with  the  best  technology  in  the  most 
efficient  way.  A  special  thanks  to  Mike 
Noonan  for  the  new  website  design 


and  Kirk  Michealson,  FS,  for  manag¬ 
ing  and  uploading  the  documents 
to  the  new  MORS  Resource  Center. 
Check  back  often  to  www.mors.org 
for  updates  and  enhancements. 

Have  fun  playing  with  the  new  MORS 
website!  If  you  have  any  questions 
about  it,  please  contact  morsoffice@ 
mors.org. 


One  of  the  most  significant  enhance¬ 
ments  is  the  MORS  Resource  Center, 
an  all-new  initiative  to  bring  our 
vast  library  of  reports,  out-briefs 
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Kirk  Michealson,  FS,  kirk.michealson@1979.usna.com 


As  noted  in  the  accompa¬ 
nying  article  by  MORS 
Chief  Executive  Officer 
Susan  Reardon,  the  Society 
recently  launched  a  new 
website  and  resource  man¬ 
agement  system  designed  to  provide 
members  of  the  national  security  op¬ 
erations  analysis  community  access 
to  information  on  MORS  events  and  a 
broader  range  of  information  concern¬ 
ing  our  profession. 


Figure  1 
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Figure  2 


General/personal  links 

Information  available 

Home 

Returns  to  the  MORS  homepage 

About  MORS 

Provides  the  MORS  mission,  background, 
heritage,  services  provided,  and  links  to 
key  personnel 

My  MORS 

Your  user  account,  where  you  can  find  and 
update  your  profile,  bio,  addresses,  com¬ 
munications,  demographics,  downloads, 
privacy  &  subscriptions,  communities, 
donations;  pay  for  outstanding  orders; 
change  user  name;  and  reset  password 

Join 

Links  to  join  as  an  individual  member  or 
an  industry/institutional  partner 

Shop 

Links  to  join,  purchase  books,  and  sub¬ 
scribe  to  Military  Operations  Research  and 
Phalanx 

My  Cart 

Displays  the  description,  quantity,  price, 
and  subtotal  for  purchases  in  progress 

A  benefit  to  MORS  members  is 
exclusive  access  to  meeting  reports, 
community  reports,  Military  Opera¬ 
tions  Research,  and  past  Phalanx  is¬ 
sues.  As  the  website  organization  is 
discussed  in  the  next  few  paragraphs, 
the  additional  access  MORS  members 
have  will  be  highlighted. 

The  home  page  has  six  general/ 
personal  links  in  the  blue  head¬ 
er;  eight  activity  links  at  the 


top  of  the  page  in  the  gray  bar  right 
below  the  header;  rotating  pictures; 
three  sections  of  quick  links  (up¬ 
coming  events,  MORS-related  news 
articles,  and  the  new  resource  center); 
links  to  the  MORS  Government  Spon¬ 
sors;  links  to  the  MORS  Industry  and 
Institutional  Partners;  Join,  Contact 
Us,  and  My  MORS  links  in  the  bottom 
blue  bar;  and  the  privacy  statement 
and  terms  of  use  links  at  the  bottom 
of  the  page. 
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For  the  six  general/personal  links  in 
the  header  (Figure  1),  there  are  links 
to  return  to  the  homepage,  About 
MORS,  Join,  My  MORS,  Shop,  and 
My  Cart. 

The  information  available  through  these 
links  is  listed  in  the  table  (Figure  2).  Your 
personal  data  is  protected  through  the 
use  of  encryption  via  the  Secure  Socket 
Layer  (SSL)  protocol.  The  full  MORS 
privacy  statement  (link  at  the  bottom  of 
the  page)  discusses  the  MORS  policy 
on  the  collection,  use,  and  security  of 
personal  information. 

There  are  eight  MORS  activity  links  at 
the  top  of  the  page  in  a  gray  bar  right 
below  the  website  header.  Through 
these  links,  there  is  information  avail¬ 
able  for  everyone,  and  for  some  of  the 
activities,  there  is  additional  informa¬ 
tion  available  for  members  only. 

Membership  Activities 

•  Information  on  membership  ben¬ 
efits  and  rates,  plus  links  to  join, 
information  on  junior  analysts, 
student  members,  industry  and 
institutional  partners,  and  sustain¬ 
ing  contributors. 

Education  Activities 

•  Information  on  MORS  continuing 
education  programs,  plus  links  to 
upcoming  tutorials  and  courses, 
information  on  the  next  education 
colloquium,  MORS  reading  list, 
and  student  webinars. 

Event  Activities 

•  List  of  recently  completed  events, 
plus  links  to  the  symposium  page 
(ACP,  WG  charters,  WG  tutorials), 
special  meetings  page  (list  of  com¬ 
pleted  events  1985-2014,  special 
meeting  tutorials,  and  brief  sum¬ 
maries  of  completed  special  meet- 
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Figure  5 
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Upcoming  Events 


ings),  and  educational  colloquium 
and  industry  showcase  page. 

The  events  section  hosts  the  new  pre¬ 
senter  center  for  symposium  abstract 
submission,  presentation  and  form 
uploads,  and  the  reviewer  center  for 
chairs  and  working  group  members  to 
review,  rate,  and  select  abstracts. 


•  Additional  for  members:  Ability  to 
search  the  meeting  repository  for 
completed  final  reports,  leader¬ 
ship  briefs,  synthesis  group/work¬ 
ing  group  outbriefs,  and  other 
selected  documents. 

Community  Activities 

•  Overview  of  MORS  Communities 
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Figure  6 


Which  search  would  you  like  to  use? 

Simple  Search 

Advanced  Search 

Figure  7 
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of  Practice  (CoP),  CoP  tutorials, 
and  links  to  active  MORS  CoP 
pages  (currently  Affordability 
Analysis  and  Wargaming).  The 
individual  CoP  pages  provide  an 
overview  of  the  CoP,  links  to  the 
symposium  working  groups  and 
special  meetings,  and  a  calendar 
of  upcoming  CoP  meetings  and 
events. 

•  Additional  for  members:  Ability 
to  search  the  CoP  repository  for 
completed  minutes,  briefs,  and 
other  selected  documents. 

Publication  Activities 

•  Information  on  the  three  types  of 
MORS  publications  (i.e.,  books, 
Phalanx  and  Military  Operations 
Research)  and  links  to  more  infor¬ 
mation  on  each. 

•  Additional  for  members:  Access 
to  Military  Operations  Research 
and  past  Phalanx  issues. 

Research  Activities 

•  The  new  MORS  Resource  Center 
with  links  to  search  MORS  special 
meeting  summaries,  oral  histories, 


and  the  MORS  reading  list. 

•  Additional  for  members:  Abil¬ 
ity  to  search  for  past  meeting 
documents,  CoP  documents,  and 
access  to  Military  Operations  Re¬ 
search  and  past  issues  of  Phalanx. 

Recognition  Activities 

•  Links  to  MORS  awards  and  prizes 
to  learn  more  about  them,  the  his¬ 
tory  of  distinguished  winners,  and 
how  to  nominate  for  the  Barchi 
Prize,  David  Rist  Prize,  Hughes 
Award,  Moore  Graduate  Re¬ 
search  Prize,  MOR  Journal  Award, 
Rosenthal  Competition,  the  Tis¬ 
dale  Prize,  Thomas  Award,  Walker 
Award,  and  Wanner  Award. 

Career  Activities 

•  This  special  section  allows  OR 
practitioners  seeking  new  oppor¬ 
tunities  the  opportunity  to  post 
their  resumes.  It  also  allows  insti¬ 
tutions,  companies,  and  agencies 
seeking  analysts  to  access  them. 

In  the  center  of  the  homepage,  there 
are  three  columns  with  quicklinks. 


In  the  left  column,  there  are  links  to 
the  upcoming  events.  In  the  center 
column,  there  are  links  to  MORS- 
related  news  articles,  messages,  and 
announcements.  In  the  right  column, 
there  are  links  to  the  resource  center  to 
search  for  MORS  documents,  books, 
periodicals,  and  journals. 

Document  Search 

For  each  type  of  document  search  (i.e., 
meeting  summary,  oral  history,  meeting 
document,  CoP  document,  and  past 
Phalanx  issues),  there  are  two  buttons: 

•  Full  list  displays  the  full  list  of  the 
documents  in  the  specific  type  of 
repository.  In  the  list,  you  can  click 
the  column  header  to  sort  alpha¬ 
betically  or  reverse  alphabetically. 

•  The  search  feature  does  a  full  text 
search  of  documents  through  two 
different  methods: 

o  Simple  search:  Uses  a  single 
criterion  to  search  all  metadata 
or  documents.  The  criterion  may 
be  part  of  a  word,  a  full  word, 
or  multiple  words.  It  is  not  case 
sensitive. 

o  Advanced  search:  Uses  multiple 
criteria  to  search  selected  meta¬ 
data  or  documents.  It  allows 
selection  of  metadata  to  search 
parameter  (i.e.,  CoP,  month, 
document  title,  or  year)  and 
search  method  (i.e.,  contains, 
doesn’t  contain,  starts  with,  and 
ends  with).  Documents  can  be 
searched  with  multiple  words  or 
phrases  (using  “and”  or  “or”).  It 
is  not  case  sensitive. 

The  new  MORS  website  is  organized 
better  to  quickly  find  the  information 
needed,  and  for  MORS  members  the 
new  document  search  capability  is 
much  superior  for  finding  previous 
meeting  reports.  Have  fun  playing  with 
the  new  MORS  website!  If  you  have 
any  questions  about  it,  please  contact 
morsoffice@mors.org. 
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Building  the  New 

MORS  Document 
Repository 

Kirk  Michealson,  FS,  kirk.michealson@1 979.usna.com 


As  mentioned  in  the 

“Harnessing  Technology  to 
Serve  Our  Members”  and 
“The  New  WWW.MORS. 
ORG”  articles  in  this  issue, 
MORS  is  creating  several 
document  repositories  for  MORS 
members.  Two  of  the  repositories  are 
complete  with  all  available  documents 
uploaded  and  ready  for  members- 
only  review. 

•  Communities  of  Practice  (CoP) 
Repository.  All  CoP-related 
documents  on  the  previous 
MORS  website  have  been 
uploaded.  The  CoP  Repository  is 
organized  by  CoP  name  and  CoP 
document  name. 

•  Previous  Phalanx  repository. 
Thanks  to  MORS  Fellow  Lee 
Dick’s  40th  Anniversary  of  Phalanx 
articles  and  the  more  recent 
electronic  versions,  all  available 
Phalanx  issues  from  the  first 
volume,  first  issue  in  1966  have 
been  uploaded.  The  Phalanx 
repository  is  organized  by  issue 
year  and  month. 

Two  other  repositories  are  being 
populated  and  will  take  a  little  more 
time  to  complete.  Kirk  Michealson, 


FS,  is  leading  the  effort  to  build 
meeting  summary  and  meeting 
reports/outbriefs  repositories.  He 
is  trying  to  collect  reports  from  all 
1 03  special  meetings  in  the  “List  of 
Completed  Meetings”  link  at  http:// 
www.mors.org/Portals/23/Docs/ 
Events/Completed%20MORS%20 
Meetings.pdf. 

The  meeting  summary  repository 
includes  brief  overviews  of  each 
meeting,  and  include  which  Phalanx 
issue  the  meeting  report  was 
published  in.  Meeting  summaries 
are  viewable  by  members  and 
nonmembers.  Hopefully,  nonmembers 
will  review  the  meeting  summaries 
and  want  to  become  members  to 
review  the  corresponding  Phalanx 
article  and  other  meeting  reports.  This 
repository  is  organized  by  the  meeting 
title  and  year.  As  of  mid-January: 

•  26  overviews  have  been  uploaded 
to  the  meeting  summary 
repository,  and 

•  90  meetings  had  their  meeting 
reports  published  in  Phalanx. 

The  meeting  reports/outbriefs 
repository  is  available  to  members 
only  and  consists  of  meeting  final 


reports,  sponsor/leadership  briefs, 
synthesis  group-working  group 
outbriefs,  and  other  selected  files,  if 
available.  This  repository  is  organized 
by  year,  meeting  title,  and  document 
type.  As  of  mid-January: 

•  24  meetings  have  provided  all 
their  available  documents 

•  61  final  reports  have  been 
uploaded, 

•  28  sponsor  /  leadership  briefs 
have  been  uploaded, 

•  27  meetings  provided  their 
synthesis  group-working  group 
outbriefs,  which  have  been 
uploaded,  and 

•  39  other  files  have  been  uploaded. 

A  total  of  156  files  have  been  included 
in  the  meeting  report/outbriefs 
repository. 

Coming  soon  to  the  repository 
will  be  the  entire  collection  of  the 
Military  Operations  Research  journal, 
including  back  and  current  issues. 

The  journal  repository  will  replace 
the  current  system  for  online  journal 
access  for  members  and  online 
subscribers  and  will  offer  individual 
articles  for  sale  to  others. 
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A  Commitment  to  Life-Long  Learning: 

83rd  Symposium 

Planning  Update 

Ronda  J.  Syring,  Johns  Hopkins  University  Applied  Physics  Laboratory,  ronda.syring@jhuapl.edu 


he  83rd  MORS  Symposium 
will  be  a  unique  opportunity  to 
help  you  grow  professionally, 
share  your  work,  and  develop 
strong  relationships  with  a 
diverse  and  talented  group  of 
professionals.  The  “live”  symposium 
will  be  held  at  the  DoD  Mark  Center 
and  Hilton  Alexandria  Mark  Center  in 
Alexandria,  Virginia,  June  22-25,  2015. 
The  virtual  segment  of  the  symposium 


special  sessions,  tutorials,  demonstra¬ 
tions,  posters,  continuing  education 
unit  (CEU)  granting  courses,  and  the 
INFORMS  Certified  Analytics  Profes¬ 
sional  (CAP)  exam  offered. 

This  year’s  program  will  include  both 
classified  and  unclassified  presenta¬ 
tions,  as  well  as  presentations  by 
analysts  from  our  five  eyes  partner  na¬ 
tions  (Australia,  Canada,  New  Zealand, 


informative  and  popular  session,  will 
immediately  follow  the  plenary  keynote 
address.  The  concurrent  sessions  for 
the  composite  groups,  working  groups, 
and  distributed  working  groups  begin 
after  lunch  and  continue  through  Thurs¬ 
day  afternoon. 

The  CEU  courses  will  include  at  least 
three  exceptional  offerings.  The  first, 
“Introduction  to  Analysis  for  Practitio- 


83rd  SYMPOSIUM 

22  -  25  June  2015  *  Alexandria,  VA 


GROWTH  THROUGH  PROFESSIONAL  DEVELOPMENT 
AND  CONTINUING  EDUCATION 


will  be  conducted  July  22-23,  2015. 
The  theme,  “National  Security  Ana¬ 
lysts:  Growth  through  Professional  De¬ 
velopment  and  Continuing  Education,” 
reflects  the  society’s  commitment  to 
helping  you  maintain  your  proficiency, 
technical  competence,  and  profes¬ 
sional  development. 

We  will  have  seven  composite  groups, 
33  working  groups,  and  two  distrib¬ 
uted  working  groups.  In  addition, 
there  will  be  a  plenary  session,  several 


and  the  United  Kingdom).  The  virtual 
session  will  host  only  unclassified, 
publically  releasable  briefings.  The 
symposium  week  begins  on  Monday, 
June  22,  with  the  Rist  prize  competi¬ 
tion,  tutorials,  and  CEU  courses.  Vice 
Admiral  James  D.  Syring,  USN,  Direc¬ 
tor,  Missile  Defense  Agency,  will  be 
the  plenary  session  keynote  speaker 
on  Tuesday  morning,  June  23.  You 
may  read  his  biography  at  www.mda. 
mil  or  in  the  December  2014  edition 
of  Phalanx.  The  sponsor’s  panel,  an 


ners,”  is  designed  for  new  analysts  and 
provides  a  fundamental  understanding 
of  the  performance  of  analysis  in  mili¬ 
tary  studies  through  a  series  of  lessons 
taught  by  seasoned  senior  analysts 
who  have  vast  experience  in  conduct¬ 
ing  military  and  civilian  studies.  The 
second  course,  “Introduction  to  Analy¬ 
sis  for  Study  Leaders,”  is  designed 
for  new  study  leaders  or  soon-to-be 
designated  program  managers.  It  will 
address  the  skillsets  and  project  plan¬ 
ning  information  essential  for  leading 
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technical  studies  that  address  effec¬ 
tiveness  and  cost  analyses.  The  third 
course,  “Introduction  to  Wargames  and 
Technology,”  is  designed  for  those  with 
a  desire  to  learn  about  wargaming  as 
an  operations  research  tool  for  analysis 
with  an  additional  slant  on  technology. 
The  goal  is  to  provide  a  fundamental 
understanding  of  how  wargaming  as 
another  form  of  simulation  supports 
analytical  studies. 


The  special  sessions  promise  to  be 
very  interesting,  and  will  for  the  first 
time  include  the  best  paper  presenta¬ 
tion  from  the  Australian  Defence  Oper¬ 
ations  Research  Symposium  (DORS), 
the  best  paper  presentation  from  the 
US  Naval  Academy  mathematics 
department,  and  an  education  panel 
discussion.  Throughout  the  remainder 
of  the  symposium,  special  session 
topics  will  include  the  MORS  Rist  and 
Barchi  prize  winners,  the  Strategist’s 
Corner,  the  Deployed  Analyst  Session, 
featuring  analysts  from  across  the  De¬ 
partment  of  Defense  discussing  their 
recent  deployment  experiences,  and 
the  MORS  Heritage  Session,  which 
always  features  fascinating 
presentations  related  to 
the  history  of  opera¬ 


While  at  the  83rd  MORS  Symposium, 
don’t  overlook  the  well-attended  net¬ 
working  event  on  Tuesday  evening  at 
the  Hilton  Alexandria  Mark  Center.  It  is 
a  guaranteed,  excellent  way  to  make 
new  friends  and  renew  old  friendships 
within  our  national  security  analyst 
community.  We  are  working  with  the 
MORS  office  to  examine  the  possibil¬ 
ity  of  scheduling  another  networking 
event  on  Wednesday  evening.  Sched¬ 
uling  of  the  event  will  be  dependent 
on  cost  and  participation.  Check  the 
MORS  website  (www.mors.org)  for 
updates  on  this  potential  event. 


Make  plans  to  now  to  join  us  at  the 
83rd  MORS  Symposium.  Register 
early  or  use  the  “Invoice  Me”  option 
under  the  payment  method  during 
checkout  to  secure  the  early  registra¬ 
tion  rate  by  April  1 , 2015. 


We’ve  heard  our  senior  leaders  say 
that  we  must  stay  ahead  of  change, 
think  globally,  and  be  innovative.  Do 
not  miss  this  tremendous  opportunity 
to  showcase  your  work,  collaborate, 
learn,  and  grow  professionally. 


tions  research  in  the  US  military.  Ad¬ 
ditionally,  there  will  be  presentations 
about  MORS  workshops  completed 
during  the  months  leading  up  to  the 
symposium,  a  Junior-Senior  Analyst 
Session,  and  MORS  sponsor  sessions 
on  special  topics  of  particular  inter¬ 
est  to  the  sponsors.  The  US  Naval 
Academy  and  Australian  DORS  best 
paper  presentations  join  the  standing 
presentations  by  the  service  acad¬ 
emy  winners  of  the  Hollis  and  Cap¬ 
stone  Awards.  Other  special  sessions 
include  presentations  from  the  Office 
of  the  Director  of  Naval  Intelligence 
and  from  the  MORS  Communities  of 
Practice.  The  Education  Panel  Discus¬ 
sion  will  include  discussions  from  a 
collection  of  universities. 


The  83rd  MORS  Symposium  also 
features  a  full  program  of  posters  and 
demonstrations.  Participants  will  have 
an  opportunity  to  have  hands-on  ex¬ 
perience  with  analytic  tools,  as  well  as 
examine  a  wide  array  of  projects  and 
discuss  techniques  of  interest  or  ad¬ 
vances  in  the  state  of  the 
art  with  colleagues. 
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The  Wargaming  CoP  holds  regular  “Brown  Bag”  lectures  at  the  CAPE  Offices  in  Mark  Center,  Arlington.  The  lectures  are 
also  “broadcast”  via  telephone  conference  and  are  focused  on  the  following  themes: 

•  Tools  for  the  definition,  design,  execution,  and  analysis  of  analytic,  training,  education  games 

•  Methods  from  other  disciplines  that  may  be  of  use  in  wargaming 

•  Other  topics  of  interest  to  the  group  at  large:  results  of  past  games,  the  theoretical,  practical,  policy,  and  legal  issues 
concerning  wargaming 


Speaker 

Date 

Topic 

Elizabeth  Bartels 

February  18,2015 

Better  Game  Design  through  (Deductive) 
Social  Science 

Guy  Halftech 

March  25,2015 

Flow  to  Use  Games  to  Discover  Your  Cogni¬ 
tive  Potential 

Mike  Garrambone 

May  21,2015 

Tutorial  and  Practicum — Drive  on  Metz 
Wargame  at  the  83rd  MORSS 

Additional  lectures  are  being  planned.  Suggestions  welcome! 


To  be  included  among  the  wargaming  “Brown  Baggers,”  contact  Mike  Ottenberg  at  michael.a.ottenberg.ctr@mail.mil 

r  \ 

MORS  is  exploring  the  possibility  of  establishing  a  Risk  Assessment  and  Analysis  Community  of  Practice.  COPs 
typically  meet  every  1-2  months  for  about  an  hour  with  agendas  varying  from  briefings  on  important  new  con¬ 
cepts  to  debates  on  controversial  issues.  Most  members  attend  via  phone.  Please  contact  the  MORS  office  at 
MORSOFFICE@mors.org  if  you  are  interested  in  being  part  of  this  COP. 

V _ ) 
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On  December  1 1th,  a  group  of  MORSians  and  government  leaders  in  the  national  security  analysis  community 
gathered  at  the  Hyatt  Regency  in  Crystal  City  to  discuss  the  needs  of  our  workforce  in  the  immediate  future.  It  was  a 
open  exchange  between  the  private  sector  providing  analysis  to  government  customers. 


MORS/MAS 


MORS  Junior  Analyst  Program: 

A  Personal  Insight 

Julie  A.  Seton,  PhD,  Indelible  Enterprises,  LLC,  julie@indentus.com 


When  I  was  first 

introduced  to  MORS, 

I  thought  of  myself 
as  the  quintessential 
junior  analyst.  I  was 
so  new  to  operations 
research  that  I  didn’t  fully  understand 
its  scope.  I  attended  my  first  MORS 
in  2002  and  gave  my  first  MORSS 
presentation  in  the  wargaming 
working  group  to  a  group  of  people 
I  didn’t  know.  I  sat— alone— through 
other  wargaming  presentations.  I 
was  lost  and  didn’t  understand  the 
working  group  structure  nor  did 
I  fathom  the  immense  value  that 
belonging  to  MORS  would  come  to 
provide  to  me. 

Fast  forward  to  December  2009.  I  no 
longer  qualified  as  a  junior  analyst. 
Operations  research  had  become  less 
of  an  enigma.  I  found  myself  serving 
on  the  MORS  Board  of  Directors  with 
interests  in  promoting  MORS  to  the 
outside  world  and  seeking  to  identify 
the  many  benefits  that  the  society 
provides  to  its  members. 

Within  a  year,  MORS  offered  a  special 
four-hour  workshop— specifically  for 
analysts  fresh  out  of  school  or  new  to 
the  discipline  with  less  than  1 0  years 
of  experience  in  operations  research  — 
designed  to  expose  MORS  to  these 
fresh  analytical  minds  and  to  find 
out  what  they  wanted  to  contribute 
to  a  professional  organization.  That 
workshop  began  the  investigation 
into  the  needs  of  newly  identified 


operations  research  analysts.  The 
2010  annual  membership  survey 
included  several  questions  directed  to 
analysts  who  had  been  in  the  field  less 
than  1 0  years  and  those  under  the 
age  of  40.  Respondents  to  that  survey 
indicated  that  the  junior  analyst  was 
interested  in  discounts  (duh— who 
isn’t!),  networking  opportunities,  and 
mentorship.  Additionally,  they  thought 
a  junior  analyst  spotlight  feature  in  the 
Phalanx  newsletter  (now  magazine) 
would  be  good.  Written  comments 
were  quite  specific: 

•  “Providing  opportunities  for 
younger  analysts  to  hear  from 
senior  analysts  about  ways  to 
develop  professionally.” 

•  “Providing  mentorship 
opportunities,  even  if  only  a  list  of 
names  of  older  national  security 
analysts  willing  to  talk  to  younger 
national  security  analysts.” 

•  “Perhaps  a  panel  at  a  MORS 
conference  with  more  senior 
analysts  offering  insights.” 

•  “Exposing  them  [junior  analysts] 
to  the  full  variety  of  national 
security  analysis  that  occurs  and 
where  it  occurs.” 

•  “Providing  resources  for  the 
young  analysts  who  are  not 
serving  in  large  analysis  shops.” 

MORS  responded  to  these  requests 
with  several  opportunities  that 
included  a  junior/senior  analyst  panel 
at  the  symposium;  the  formal  launch 
of  the  “Young  Analyst  Initiative”;  the 


MORS  Mentorship  Program  gained 
more  visibility;  and  junior  analysts 
profiles  began  appearing  in  the 
Phalanx. 

In  the  column  “The  Last  Word,”  editor 
John  Willis  described  these  junior 
analysts,  “The  Ne(x)t  Generation,”  as 
“being  born  after  1991,  members  of 
Gen  Z  would  rather  text  than  talk  ... 
they  can’t  imagine  a  world  without 
cellphones.  They  have  never  known 
a  world  without  Internet  or  terrorism.” 
(Willis,  201 1 ,  36).  In  201 1 ,  the  79th 
MORS  Symposium’s  theme  was 
“Developing  the  Next  Generation 
of  National  Security  Analysts.”  Mr. 
Norm  Reitter  and  Ms.  Angela  Severe 
worked  on  shaping  a  junior  analyst 
focus  in  the  MORS  membership.  In 
December  2013,  the  MORS  BoD 
voted  to  formally  recognize  the  junior 
analyst  sector  of  the  society  and  just 
recently,  the  definitions  and  processes 
that  shape  the  MORS  Junior  Analyst 
Program  were  accepted  into  the 
MORS  Operations  Manual  (MoM).  It  is 
all  official  now! 

The  Junior  Analyst  program  is  run  by 
and  for  junior  analyst  members  under 
the  MORS  Membership  Committee. 
Ms.  Angela  Severe,  an  analyst  with 
Lockheed  Martin,  serves  as  the 
Junior  Analyst  program  lead  with 
support  from  the  MORS  Membership 
Committee,  led  by  Dr.  Simon  Goerger. 
The  two  primary  tasks  are  outreach 
and  involvement.  Outreach  activities 
include  the  Junior  Analyst  profile 
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in  the  Phalanx,  a  junior  analyst 
panel  feature  at  the  Education  and 
Professional  Development  Colloquium 
held  in  the  spring,  and  the  Mentorship 
Program,  led  by  Mr.  Dennis  Baer,  FS. 
Involvement  activities  are  wrapped 
into  the  Junior  Analyst  Ambassador 
(JAA)  Program.  The  JAA  places  MORS 
junior  analysts  in  direct  contact  with 
MORS  Board  Committees  and  leaders 
in  the  OR  field.  This  experience  with 
the  MORS  Board  of  Directors  provides 
two  unique  skill-building  opportunities 
for  junior  analysts.  First,  the 
ambassadors  learn  about  how  MORS 
works  and  they  support  the  planning 
and  execution  of  MORS  events. 
Second,  they  advise  MORS  from  the 
perspective  of  the  up-and-coming 
analytical  community.  For  example, 
the  new  generation  of  soldiers,  “have 
grown  up  enmeshed  in  social  media, 
have  higher  expectations  about 
access  to  information,  and  young 
soldiers  expect  the  military  to  be  at 
the  frontier  of  this  communication 
revolution.”  (Szablowski  et  al.,  2012, 
27)  As  a  professional  organization 
dedicated  to  the  military  and  national 
security,  MORS  looks  to  the  junior 
analysts  to  provide  guidance  as  the 
society  embraces  social  media. 

Opportunities  abound  for  junior 
analysts,  and  these  opportunities 
are  as  valuable  for  senior  analysts  as 
mentors  and  teachers  as  they  are  for 
the  new  analysts.  The  MORS  website 
(www.mors.org)  has  details  about 
publishing,  networking,  learning, 
mentorships,  the  JAA  program,  and 
much  more. 

Now,  as  a  seasoned  MORSian,  I  find 
analysts  new  to  OR  and  encourage 
them  to  enrich  their  professional  lives 
through  MORS.  I  have  looked  at  a 
list  of  (more  than  50)  new  analysts 
who  have  been  recognized  by  MORS 
and  MAS  over  the  past  five  years  in 
the  Phalanx.  I  recognize  the  names 


as  active  MORS  members,  and  I  see 
their  professional  growth. 

For  more  information  about  the 
Junior  Analyst  Program,  contact 
the  MORS  office  and  they  will  have 
Angela  Severe  or  another  JAA 
contact  you  directly. 
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NetSci  is  one  of  the  largest 
network  science  research 
conferences  in  the  world  and, 
like  many  network  science 
events,  researchers  associated 
with  the  US  Department 
of  Defense  (DoD)  played 
a  significant  role  in  NetSci 
201 4.  We  report  on  three 
symposia  held  before  the  main 
conference  that  connected 
operations  research  and 
DoD  applications  of  network 
science.  As  we  describe  the 
content  of  the  symposia,  we 
highlight  the  connections 
between  military  applications, 
operations  research  (OR),  and 
network  science  (NS). 

_ > 

like  OR  has  taken  multidisciplinary 


Background 

The  National  Research  Council  (2005) 
defines  Network  Science  (NS)  as  “the 
study  of  network  representations  of 
physical,  biological,  and  social  phe¬ 
nomena  leading  to  predictive  models 
of  these  phenomena.”  As  stated  by 
Eric  Lang  at  NetSci,  “DoD  should  care 
about  [NS]  because  we  spend  trillions 
of  dollars  and  have  millions  of  people 
whose  well-being  we  put  on  the 
line.  We  had  better  understand  [NS] 
systems.”  Network  modeling  has  en¬ 


abled  better  awareness, 
analysis,  and  understand¬ 
ing  for  decision  makers 
across  every  aspect  of 
military  operations,  in¬ 
cluding  communications, 
logistics,  intelligence, 
training,  planning,  and 
operations.  Analysts  use 
networks  to  model  the 
DoD’s  operational  envi¬ 
ronment  to  provide  intu¬ 
ition  into  how  systems 
work  and  which  elements 
are  the  most  important 
to  network  functional¬ 
ity.  Unfortunately,  many 
of  today’s  most  impor¬ 
tant  DoD  networks  defy 
modeling  and  analysis 
by  traditional  statistics  or 
applied  mathematics.  To¬ 
day’s  complex  networks 
are  too  big,  possess 
ill-defined  organizational 
rules,  change  too 
much  (and  too  fast),  and  mani¬ 
fest  emergent  and  even  chaotic 
properties.  Into  that  breach 
steps  NS. 

Network  science  integrates 
multiple  disciplines  to  under¬ 
stand,  model,  and  analyze  ap¬ 
plications  represented  by  com¬ 
plex  dynamical  networks,  much 


and  interdisciplinary  approaches  to 
combine  quantitative  and  qualitative 
methods  and  techniques  to  solve 
management  problems.  There  is  over¬ 
lap  of  NS  with  OR.  An  OR  analyst  can 
describe  NS  in  familiar  terms:  applied 
dynamic  graph  theory  with  additional 
attribute  data,  modeled  as  a  dynamic, 
structured,  entity-linked,  interdis¬ 
ciplinary  framework.  The  strength 
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of  network  modeling  is  its  ability  to 
embrace  the  complexity  resident  in 
reality,  making  NS  an  empowering 
form  of  nonreductive  modeling  and 
OR  problem  solving  (Alderson,  2008; 
Arney  et  al.,  2014). 

The  fields  of  NS  and  OR  have  inter¬ 
twined  futures.  OR  is  an  established 
field  and  profession;  NS  is  embryonic. 
To  realize  its  potential  as  a  contribut¬ 
ing  field,  NS  is  reliant  on  its  partnering 
with  OR  to  establish  relevance  in  the 
modern  information-centric  world. 

To  grow  in  capability,  OR  is  becom¬ 
ing  reliant  on  NS  tools  for  analysis  of 
the  complex  structures,  synergistic 
processes,  emergent  behavior,  and 
overwhelming  data  that  characterizes 
real  problems.  Like  OR,  NS  merges 
the  social,  informational,  communica¬ 
tion,  and  physical  layers  of  systems 
analysis.  These  multilayered  networks 
enable  a  comprehensive  model  with 
multiple  dimensions,  tremendous 
volumes  of  data,  high  complexity, 
diversity,  and  specialization  within  the 
organization  or  system. 

Complex  networks  are  ubiquitous 
in  the  military  and  lie  at  the  core  of 
DoD  systems  and  models  including 
communication  flow,  command  and 
control,  organizational  management, 
and  information  assurance  implemen¬ 
tation.  Most  importantly,  NS  helps 
make  sense  of  big  data  structures  to 
build  the  underlying  knowledge  base 
for  situational  awareness.  The  DoD 
has  recognized  the  import  of  NS,  re¬ 


sulting  in  the  development  of  network 
warfare  commands  and  research 
centers  in  each  of  its  agencies.  For 
example,  the  DoD  launched  a  major 
doctrinal  shift  in  the  late  1990s  based 
on  NS  called  net-centric  warfare 
(Alberts  et  al.,  1999).  As  Roehner 
(2007)  reflected,  “the  real  challenge  is 
to  do  real  physics  and  real  sociology 
in  the  framework  of  network  theory.” 
The  three  symposia  from  NetSci  2014 
contributed  to  DoD’s  efforts  to  answer 
Roehner’s  challenge. 

NetSci  Symposium  on 
Network  Science  for  National 
Defense 

Network  science  and  other  emerging 
data  science  methods  are  showing 
promise  for  improving  understanding 
and  analysis  in  US  national  security 
and  intelligence  missions.  However, 
the  benefit  from  these  new  ana¬ 
lytic  methods  remains  only  in  small 
pockets  of  the  DoD  enterprise,  not 
spreading  in  a  systematic  way  to 
other  network-relevant  mission  areas 
in  the  DoD.  NS  needs  a  boost  in  its 
awareness  to  reach  its  potential  to 
solve  problems  that  are  currently 
out  of  reach  or  consideration  to  the 
DoD.  The  exchange  of  ideas  in  this 
symposium  was  intended  to  be  a  first 
step  in  broadly  exposing  the  DoD  to 
the  promise  of  NS  meeting  the  DoD’s 
needs,  and  the  DoD  to  NS  field.  Sym¬ 
posium  organizers  Mark  Breckenridge 
(OSD)  and  Ralucca  Gera  opened  the 
discussion  with  a  panel  of  network 
science  professionals  led  by  Jon  Alt 


responding  to  general  questions  with 
an  insightful  view  of  what  NS  is,  who 
does  it,  and  what  it  can  (and  can’t)  do 
for  an  organization.  The  panel  touched 
on  several  import  topics: 

•  Problems  areas  suited  for  NS. 
Modeling  is  at  the  heart  of  deter¬ 
mining  which  problems  are  suited 
for  NS  approaches.  Some  tech¬ 
niques  and  problems  are  more 
appropriate  than  others.  Ideal 
cases  for  NS  involve  relationship 
data  that  can  be  described  by  a 
network.  Analysts  build  network 
models  not  only  because  they 
are  descriptive,  but  also  explana¬ 
tory-providing  insight  into  why 
things  are  the  way  they  are. 

•  Limitations  of  network  science. 

The  panel  identified  two  signifi¬ 
cant  obstacles:  understanding  the 
nature  of  relationships  and  data 
availability  and  quality.  Although 
NS  is  not  purely  a  data-driven 
endeavor,  data  are  important.  Be¬ 
cause  networks  are  characterized 
by  interdependencies,  appropriate 
and  accurate  data  must  be  col¬ 
lected  and  processed,  preserving 
quality  in  the  model  while  reduc¬ 
ing  the  noise  and  error. 

•  Profiling  a  network  scientist. 

The  panel  developed  a  profile 
of  skills  a  DoD  network  scientist 
might  possess.  Further  discus¬ 
sion  concluded  that  organizations 
shouldn’t  look  for  just  one  hyper- 
talented  scientist;  rather,  form  NS/ 
OR  teams  with  certain  qualities 
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and  capabilities.  Such  a  team 
must  be  well  rounded,  possess¬ 
ing  skills  in  several  quantitative 
fields  and  exposure  to  the  human 
dimension  of  the  application. 

Several  speakers  followed  the  panel 
discussion,  sharing  network  and  data 
science  practices.  Summaries  of  two 
of  these  presentations  follow. 

•  A  Large-Graph  Comparison  Mea¬ 
sure  for  the  Topology  of  the  Inter¬ 
net  (presented  by  Ralucca  Gera). 
Graph  theory  is  a  direct  predeces¬ 
sor  to  complex  networks.  It  was 
one  of  the  first  scientific  fields  to 
describe  and  explore  connected¬ 
ness  and  relationships  between 
entities.  As  DoD  analysts’  needs 
transition  from  simple,  static,  and 
relatively  small  graphs  to  com¬ 
plex,  dynamic,  and  large  ones, 
there  is  a  transition  in  thinking 
needed  from  graph  theory  to 

NS.  This  presentation  extended 
traditional  graph-theoretic  con¬ 
cepts  to  analogous  ideas  in  NS. 
For  example,  Figure  1  illustrates 
the  idea  of  graph  comparison.  In 
graph  theory,  we  ask  if  two  graphs 
or  subgraphs  are  the  same,  or 
isomorphic.  In  complex  networks, 
we  measure  the  level  of  similarity 
between  two  networks. 

•  Network  Science  for  Military  Ap¬ 
plications:  Practices,  Pitfalls,  and 
Potentials  (presented  by  Dave 
Alderson).  This  presentation 
summarized  prevalent  pitfalls  in 
the  application  of  NS  to  system 
design  and  opportunities  for  NS 
contribution  in  DoD  applications 
such  as  social  media  and  other 
large,  unstructured  datasets. 

Other  speakers  included  Pete  Schirmer 
and  Douglas  Yeung  (RAND),  Ray  Zim¬ 
merman  (PERSEREC),  Paul  Lester 
(RFT),  and  Santiago  Gil  (Center  for 
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Figure  1 .  Graph  theoretic  vs.  complex 
network  measures. 


Complex  Net¬ 
works  Research 
at  Northeastern 
University).  The 
symposium 
concluded 
with  a  working 
session  during 
which  partici¬ 
pants  divided 
into  groups  to 
discuss  relevant 
DoD  questions. 

You  can  find  a 
link  to  a  sum¬ 
mary  by  Jon 
Rog inski  (NPS) 
of  the  working 
group  discussion  and  the  symposium’s 
proceedings  on  the  Network  Science 
for  National  Defense  Symposium 
webpage  at  http://faculty.nps.edu/ 
rgera/conferences/NetSci2014/dist/. 
This  symposium  increased  awareness 
of  the  potential  for  NS  techniques  to 
impact  more  areas  of  DoD  operations. 
The  symposium  plans  to  convene 
again  yearly  to  discuss  additional  DoD- 
relevant  topics,  further  spread  NS  and 
OR  awareness  and  compatibility,  and 
chart  the  way  forward  for  greater  ana¬ 
lytical  support  to  national  defense. 

NetSci  Symposium  on 
Team  Networks 

Examples  abound  in  which  teams 
perform  better  than  groups  of  indi¬ 
viduals— even  when  the  individuals 
are  more  skilled  than  single  members 
of  the  team.  Researchers  and  prac¬ 
titioners  speculate  that  the  success 
of  teams  stems  in  part  from  their 
multidisciplinarity  and  their  ability  to 
assimilate,  reinforce,  and  recombine 
knowledge  and  talent  (Uzzi  et  al., 
2013).  The  enhanced  capacity  of  team 
performance  over  individual  sug¬ 
gests  there  is  potential  for  moving  the 
boundaries  of  human  achievement  for¬ 
ward  through  more  and  better  use  of 
teamwork  in  networked  organizations. 


Yet,  knowledge  about  what  factors  are 
the  primary  drivers  of  success  or  how 
these  drivers  operate  remains  nascent. 
The  NetSci  Symposium  on  Teams 
sought  to  develop  a  framework  for 
creating  formalized  theory,  improved 
metrics,  and  viable  models  of  team 
dynamics.  Discussed  at  the  symposium 
were  recent  developments  in  team-re¬ 
lated  cognitive  science  (team  cognition), 
industrial  and  organizational  psychology 
(science  of  team  science),  computer 
science  and  statistics  (science  of  suc¬ 
cess),  and  management.  The  sympo¬ 
sium’s  conclusion  was  that  this  topic  is 
ripe  for  exploration  as  an  integral  part  of 
DoD  organizational  and  doctrinal  devel¬ 
opment.  Team  networks  enable  groups 
of  people  to  build  knowledge,  reach 
consensus,  achieve  breakthroughs,  and 
generally  perform  complex  problem 
solving  that  would  not  be  attainable 
through  either  individual  efforts  or  a 
sequence  of  additive  contributions.  A 
critical  question  in  the  military  is  how  to 
improve  the  performance  of  teams  and 
of  multiteam  systems  (teams  that  work 
together  to  carry  out  missions). 

Symposium  organizers  Kate  Coronges 
and  Chris  Arney  brought  together  sev¬ 
eral  academic  communities— network 
scientists,  team  and  communication 


PHALANX  -  MARCH  201 5 


PROFESSIONAL  FEATURES 


scientists,  cooperative  systems  scien¬ 
tists,  and  game  theorists,  many  with 
DoD  connections.  Noshir  Contactor 
(Northwestern)  and  Alice  Leung  (Ray¬ 
theon  BBN)  presented  frameworks  to 
conduct  social  experiments  in  multi¬ 
team  systems.  Experimental  data  on 
communication  activity  reveals  motifs 
or  patterns  of  activity  (shown  in  Figure 
2)  that  can  be  used  as  explanatory 
variables  to  model  team  processes 
(dynamics)  and  outcomes  (e.g.,  per¬ 
formance).  Elisha  Peterson  (Applied 
Physics  Lab)  presented  a  group-level 
game  theoretic  framework  based  on 
Shapley  theory,  which  teases  out  the 
rationality  of  the  individual  versus  the 
rationality  of  the  group.  Measures  of  a 
person’s  individual  contribution  to  the 
group  using  various  subset  boundar¬ 
ies  can  assess  altruism  and  compe¬ 
tition  within  team  members.  Darryl 
Ahner  (Air  Force  Institute  of  Technol¬ 
ogy)  presented  a  model  of  information 
need  and  sharing  based  on  Miller, 
Miller,  and  Shattuck  (2007)  situated 
cognition  model.  Leslie  DeChurch 
(Georgia  Tech)  gave  the  plenary  talk 
on  “Leadership  and  Networks.”  Two 
panel  sessions  predicting  the  future  of 
team  collaboration  processes  models, 
one  from  a  mathematical  modeling 
perspective  and  the  second  based  in 
the  social  and  behavioral  sciences, 
concluded  the  workshop. 

NetSci  Symposium 
on  Education 

Due  to  the  complexity  of  today’s  oper¬ 
ational  environment,  it  is  essential  that 
future  leaders,  including  military,  are 
able  to  naturally  leverage  the  connec¬ 
tivity  of  disciplines  rather  than  reduc¬ 
ing  problems  into  pieces  or  groupings 
that  are  addressed  individually  with 
traditional  “stove  piped”  disciplinary 
expertise.  In  anticipation  of  preparing 
the  next  generation  to  operate  effec¬ 
tively  in  the  complex,  networked  en¬ 
vironment,  a  group  of  educators  have 
been  harnessing  students’  inherent 


Simple  Graphs: 

•  Graph  isomorphism 


Isomorphic  Petersen  Graphs 

•  Sub-graph  isomorphism 


interest  in  networks  to  engage  them  in 
interdisciplinary  problem  solving. 

The  NetSciEd  Symposium,  organized 
by  Catherine  Cramer  and  Stephen 
Uzzo  of  New  York  Hall  of  Science,  Hiro- 
ki  Sayama  from  Binghamton  University, 
and  Gene  Stanley  and  Paul  Trunfio  from 
Boston  University,  and  Lori  Sheetz, 
focused  on  NS  teaching  and  learning  at 
all  levels  of  formal  and  informal  educa¬ 
tion.  Topics  discussed  were: 

•  Teaching  teachers  network  sci¬ 
ence  concepts 

•  Network  science  in  K-16  practice 
and  policy 

•  Network  science  in  the  military 

•  Network  science  in  informal 
education 

•  Tools  for  teaching  network  science 

•  New  directions  in  learning  science 

•  Developing  metrics  for  effective 
educational  collaboration  networks 

•  Applying  network  science  concepts 
to  the  Common  Core  framework. 


Complex  Networks: 

•  Similarity  ? 


Speakers  included  Mason  Porter  (Uni¬ 
versity  of  Oxford),  Toshihiro  Tanizawa 
(Kochi  National  College  of  Technol¬ 
ogy,  Japan),  Brooke  Foucault  Welles 
(Northeastern  University),  and  Robin 
Wilkins  (UNC  Greensboro). 

Components  of  networks  have  been 
used  as  a  tool  for  teaching  math,  com¬ 
puter  science,  and  technology  for  many 
years.  More  recently,  network  scientists 
have  expanded  these  efforts  by  devel¬ 
oping  and  sharing  informal  outreach 
materials  to  demonstrate  how  NS  can 
successfully  be  used  to  engage  stu¬ 
dents  in  STEM  fields  (Harrington  et  al., 
2013;  Sanchez  and  Brandle,  2014)  and 
to  learn  problem-solving  skills.  These 
successes  led  to  a  model  in  which 
NS  is  used  to  teach  abstract  con¬ 
cepts  within  formal  education  settings 
including  the  Common  Core  Learning 
Standards.  Lori  Sheetz  presented  her 
model  for  bringing  NS  into  high  school 
STEM  curricula.  Her  educational  frame¬ 
work  was  developed  from  working  with 
teachers  and  school  administrators  by 


Figure  2.  Motifs  or  patterns  of  activity  are  identified 
during  field  experiments  or  computer  games  and  used 
to  predict  team  dynamics  and  performance  outcomes. 
This  figure  demonstrates  motifs  as  presented  by  Leslie 
DeChurch  at  the  conference. 
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shifting  NS  from  an  informal  science 
research  tool  to  a  blended  formal/infor¬ 
mal  educational  topic. 

Conclusion 

Network  science  is  poised  to  play  an 
important  role  in  the  future  of  DoD 
critical  operational  and  organizational 
applications  (e.g.,  net  warfare,  wire¬ 
less  technology,  intelligence  process¬ 
ing).  In  recent  years,  DoD  researchers 
have  become  a  major  force  in  devel¬ 
oping  the  field  to  improve  our  under¬ 
standing  of  the  human  domain.  At 
NetSci,  we  were  excited  to  see  many 
applications  of  NS  in  the  military  and 
evidence  of  its  ties  and  relationships 
to  OR  with  an  emphasis  on  situational 
awareness,  learning  and  teaching 
strategies,  and  organizational  dynam¬ 
ics.  DoD  has  played  a  significant  role 
supporting  NS  research  and,  based 
on  what  we  heard  at  these  three  sym¬ 
posia,  NS  will  continue  to  play 
significant  roles  in  the  future  of  DoD. 
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Analytic  Wargaming 

on  the  Rise 

Jeff  Appleget,  Naval  Postgraduate  School,  jaappleg@nps.edu;  and  Fred  Cameron,  formerly 
Centre  for  Operational  Research  and  Analysis  (Canada),  frederickwpcameron@gmail.com 

<  > 
"A  reinvigorated  wargaming  effort  will  develop  and  test  alternative 

ways  of  achieving  our  strategic  objectives  and  help  us  think  more 

clearly  about  the  future  security  environment." 

— SecDef  Defense  Innovation 

Initiative  memo, 

November  1 5, 201 4 

- - - 

"The  first  and  most  important  thing  is  our  people.  The  second  thing 
is  what  we  want  to  do  to  reinvigorate  wargaming." 

— Deputy  Defense  Secretary  Bob  Work,  on  the 
Defense  Innovation  Initiative, 

Defense  News  interview,  November  24, 2014 


rom  its  inception,  military  op¬ 
erations  research  has  been  in¬ 
exorably  linked  to  wargaming; 
the  relationship  is  symbiotic 
and  has  benefited  practitioners 
in  both  disciplines.  Indeed,  the 
overlap  in  a  Venn  diagram  of  the  dis¬ 
ciplines  of  military  OR  and  wargaming 
is  so  large  it  is  hard  to  find  examples 
where  wargaming  will  not  benefit  from 
OR,  and  where  military  OR  will  not 
benefit  from  wargaming. 

Analytic  wargames  are  designed  to 
collect  and  analyze  information  from 
wargame  play,  and  these  results  either 
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feed  directly  into  a  decision,  or  are 
used  to  develop  other  analytic  prod¬ 
ucts.  Outputs  of  analytic  wargames 
such  as  concepts  of  operation 
(CONOPS),  courses  of  action  (COAs), 
and  operations  plans  (OPLANs)  are 
comq^nly  used  to  “feed”  other  ana¬ 
lytic  activities  or  serve  as  the  opera¬ 
tional  foundation  for  computer-based 
combat  simulation  analysis.3 

Analytic  wargames  are  particularly 
useful  in  scenarios  where  uncertainty 
is  high.  Instead  of  simply  “red”  and 
“blue,”  there  may  be  many  play¬ 
ers,  all  with  unique  objectives.  This 


includes  operations  where  major  cul¬ 
tural  differences  make  understanding 
potential  actions  and  reactions  to  un¬ 
folding  events  tremendously  difficult 
or  operations  against  new,  unfamiliar 
threats  in  new  regions,  and  opera¬ 
tions  that  current  doctrine  doesn’t 
adequately  address. 

Wargaming  and  History 

Analytic  wargaming  has  had  a  long  and 
colorful  history  of  success.  The  US  Na¬ 
val  War  College  (NWC)  began  wargam¬ 
ing  Plan  Orange,  operations  against 
the  Japanese  in  1919,  and  created  a 
rich  body  of  analytic  wargaming  results 
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divided  into  three  distinctly  different 
phases  (Vlahos,  1986): 

•  1 91 9-1 927:  The  US  Navy  sails  off 
to  single-handedly  destroy  the  Im¬ 
perial  Japanese  Navy  and  relieve 
the  Philippines  just  weeks  after  a 
declaration  of  war. 

•  1928-1934:  The  US  Navy  realizes 
such  a  war  may  last  longer  and 
will  require  a  phased  approach 
necessitating  large-scale  amphibi¬ 
ous  operations  with  significant  US 
ground  forces. 

•  1 935-1 941 :  The  US  Navy  realizes 
that,  in  addition  to  the  US  Army  and 
US  Marine  Corps,  US  forces  will 
need  help  from  regional  partners. 

The  knowledge  garnered  in  more  than 
two  decades  of  NWC  wargaming  Plan 
Orange  led  Fleet  Admiral  Chester 
Nimitz  to  famously  say,  “The  war  with 
Japan  had  been  enacted  in  the  game 
rooms  at  the  War  College  by  so  many 
people  and  in  so  many  different  ways 
that  nothing  that  happened  during 
the  war  was  a  surprise— absolutely 
nothing  except  the  kamikaze  tactics 
toward  the  end  of  the  war.  We  had  not 
visualized  these.”6  An  even  more  tell¬ 
ing  tribute  to  Plan  Orange  wargaming 
came  early  in  1942  when  Nimitz  sent 
two  young  lieutenant  commanders 
back  to  the  Naval  War  College  in  New¬ 
port  to  gather  previous  wargaming 
results.  Because  NWC  had  changed 
Japanese  strengths  and  weaknesses 
in  each  year’s  student-led  wargame, 
Nimitz  knew  that  NWC  had  wargam¬ 
ing  results  from  one  of  its  annual 
wargames  that  resembled  the  actual 
Japanese  status  that  naval  intelligence 
was  reporting  to  him  (Caffrey,  2000). 

A  more  recent  analytic  wargaming 
success  was  the  Desert  Crossing 
wargame  conducted  in  1999  when 
Marine  General  Anthony  Zinni  com¬ 
manded  the  US  Central  Command. 

He  tasked  his  staff  with  conduct¬ 


ing  wargames  to  assess  what  could 
happen  if  regime  change  occurred 
in  Iraq,  deposing  Saddam  Hussein. 
The  results  were  an  eerie  prediction 
of  the  post-“Shock  and  Awe”  sec¬ 
tarian  violence  and  regional  power 
struggles  that  did  in  fact  occur  after 
the  end  of  major  combat  operations 
in  Iraq  in  2004  (US  Central  Command, 
1999).  The  wargame  would  have  been 
tremendously  successful  had  the  Na¬ 
tional  Command  Authority  given  the 
game’s  results  any  credence  as  they 
planned  for  Operation  Iraqi  Freedom. 

Computer-Based  Combat 
Simulations  Sideline  Analytic 
Wargaming 

Toward  the  latter  part  of  the  20th 
century,  the  use  of  computerized 
combat  simulations  combined  with 
other  factors  to  relegate  wargaming 
to  a  little-used  tool  for  analysis.  The 
dominant  scenario  that  the  United 
States  DoD  used  to  underpin  acquisi¬ 
tion  decisions  was  the  NATO-Warsaw 
Pact  battle  for  Europe.  This  battle  had 
been  analyzed  continually  for  decades 
and  both  sides’  intelligence  had  been 
so  well  developed  that,  by  the  1980s, 
nearly  the  entire  world  understood 
how  the  battle  on  the  north  German 
plain  would  unfold:  attack  corridors, 
force  compositions,  and  equipment, 
even  opposing  commanders  were 
all  known.  Tom  Clancy’s  novel  Red 
Storm  Rising  (Putnam,  1986)  pro¬ 
vided  a  realistic  description  of  what 
that  encounter  would  have  looked 
like,  and  demonstrated  the  amount  of 
information  commonly  available  about 
that  potential  conflict.  The  dominant 
school  of  thought  at  the  time  seemed 
to  be  that  there  was  no  need  to 
develop  new  courses  of  action  or  get 
fresh  subject  matter  expertise  on  the 
battle  to  be  fought;  all  that  was  left 
was  the  fight  itself. 

Computers  started  to  impact  military 
thought  in  the  1970s,  changing  the 


wargaming  landscape  forever.  At  first, 
computers  were  used  to  help  with 
the  bookkeeping  of  wargames,  ac¬ 
counting  for  the  physical  phenomena 
such  as  adjudicating  the  outcome  of 
engagements,  tracking  unit  and  ve¬ 
hicle  movements,  and  accounting  for 
logistics  expenditures.  The  wargame 
Battle  Analyzer  and  Tactical  Trainer  for 
Local  Engagements  (BATTLE)  utilized 
a  Wang  2200  computer  to  do  what 
computers  do  best: 

“The  software  was  therefore  designed 
to  provide  players  complete  freedom 
of  action  with  respect  to  tactics  em¬ 
ployed  and  decisions  made  during  the 
course  of  an  exercise.  Its  function  is  to 
free  players  and  controllers  from  the 
burden  of  complex,  time-consuming 
computation,  recording,  and  exer¬ 
cise  management  requirements  and 
thereby  permit  the  maximum  possible 
involvement  of  exercise  participants  in 
the  tactical  decision-making  process” 
(TRADOC,  n.d.). 

At  some  point,  the  allure  of  developing 
a  computer-based  combat  simula¬ 
tion  that  was  entirely  automated  and 
could  replicate  a  major  campaign  was 
realized,  and  “closed-loop”  combat 
simulations  started  to  become  a  staple 
of  operations  research.  Several  of  the 
major  combatant  commands  adopted 
the  Joint  Staff’s  combat  simulation 
Tactical  Warfare  Model  (TACWAR)  to 
assess  courses  of  action  and  otherwise 
augment  their  planning  processes. 

These  closed-loop  computer-based 
combat  simulations  fall  into  two  basic 
categories. 

The  first  are  theater-  or  strategic-level, 
lower-resolution  combat  simulations 
that  represent  forces  in  an  aggregate 
manner,  and  often  use  some  adapta¬ 
tion  of  heterogeneous  Lanchester 
equations  to  adjudicate  combat 
engagements  (Taylor,  1983).  Human 
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decision  making  in  these  simulations  these  combat  simulations.  Thus,  the  of  combat  power  that  were  used  in 

is  rudimentary  at  best,  such  as,  “at-  focus  of  the  decision  making  during  our  aggregate  models,  the  basis  for 

tack  when  you  have  a  3:1  advantage,”  the  Cold  War  was  on  hardware  and  those  “simple”  3:1  attack  thresholds, 

“defend  when  your  opposition  has  a  equipment  performance  while  largely 

3:1  advantage,”  and  “skirmish  when  ignoring  human  decision  making.  Resurrecting  Analytic 

neither  of  the  sides  can  muster  a  3:1  Wargaming 

or  better  force  ratio.”  Many  of  these  Analysts  perhaps  oversold  senior  US  Army  analytic  organizations  real- 

simulations  are  deterministic.  leaders  on  the  benefits  of  these  ized  that  closed-loop  combat  simula- 

closed-loop  combat  simulations,  and  tions  could  not  be  relied  upon  as  the 

The  second  are  tactical-  or  opera-  many  started  referring  to  these  simu-  single  tool  needed  to  do  analysis, 

tional-level,  higher-resolution  combat  lations  as  computerized  wargames,  Although  the  automated  decision 

simulations  that  represent  each  major  or  just  wargames.  This  obfuscated  rules  allowed  for  the  development  of 

system  or  entity  on  the  battlefield.  the  fact  that  there  was  really  very  little  stochastic  combat  models  that  could 

Movements  are  typically  scripted  from  human  decision  making  represented  be  run  numerous  times  to  ensure 

waypoint  to  waypoint  and  the  human  in  these  simulations,  and  the  decision  there  was  a  representative  set  of 

decision  making  modeled  in  these  making  that  was  represented  might  battle  outcomes,  the  automation  of 

simulations  is  to  basically  fire  or  not  not  hold  up  well  to  close  scrutiny.  the  human  decision  making  process 

fire  when  an  enemy  is  detected.  Many  A  somewhat  famous  paper  demon-  in  these  simulations  was  recognized 

of  these  simulations  are  stochastic,  strated  that  a  very  simple  homoge-  to  be  too  simplistic  to  rely  on  for  a 

and  a  single  scenario  is  run  multiple  neous  Lanchester  model  of  combat  complete  assessment  of  combat 

times  and  the  average  result  is  calcu-  produced  chaotic  and  nonintuitive  operations.  The  US  Army  Training  and 

lated  and  reported.  results  and  was  largely  ignored  by  Doctrine  Command  Analysis  Center 

the  analytic  community  (Dewar  et  al.,  (TRAC)  developed  analysis  protocols 
These  closed-loop  simulations  gener-  1991).  Instead,  more  complex  combat  that  first  used  wargames  to  thoroughly 
ate  plenty  of  numerical  output  that  can  simulations  were  developed,  fielded,  examine  different  COAs  before  decid- 

be  processed  and  plotted.  Because  and  used  with  increasing  frequency.  ing  on  a  single  course  of  action  that 

there  was  considered  to  be  little  uncer-  Many  analysts  of  that  era  will  recall  was  then  scripted  into  closed-loop 

tainty  of  how  a  battle  would  be  fought,  the  discussions  and  various  con-  combat  simulations, 

it  seemed  to  make  perfect  sense  to  structs  for  the  calculation 

place  the  burden  of  the  TRAC-White  Sands  Missile 


analysis  on 


Range  has  used  the  human- 
in-the-loop  (HITL)  computer- 
based  wargame  Janus  to  de¬ 
velop  Concept  of  Operations 
(CONOPS)  for  brigade-level 
fights  and  to  validate  new 
system  tactics,  techniques, 
and  procedures  (TTPs)  by 
bringing  in  warfighters 
from  the  various  TRADOC 
schools  to  command  the 
forces  in  Janus.  Those 
CONOPS  and  TTPs 
captured  from  the  Ja¬ 
nus  fight  were  then 
instantiated  in 

'  ' 


PROFESSIONAL  FEATURES 


the  closed-loop  simulation  Combined 
Arms  and  Support  Task  Force  Evalu¬ 
ation  Model  (CASTFOREM),  which 
provided  a  robust  look  at  how  well  our 
forces  performed  with  warfighter-de¬ 
veloped  maneuver.  Similarly  at  TRAC- 
Fort  Leavenworth,  “orders  drills”  were 
conducted  by  warfighters  to  develop 
the  division  and  corps-level  CONOPS, 
which  was  then  integrated  into  the 
Vector-in-Command  (VIC)  model. 

The  Center  for  Naval  Analyses  used 
Marine  Corps  officers  to  develop  its 
tactical  decision  rules  when  preparing 
the  amphibious  warfare  model  for  the 
amphibious  assault  vehicle  analysis  of 
alternatives  in  the  early  1990s  (Akst, 

1 995).  More  recently,  TRAC  has  lever¬ 
aged  “expert  elicitation”  techniques 
by  interviewing  serving  or  former 
brigade  commanders  to  obtain  their 
warfighting  perspective  on  various  bri¬ 
gade  combat  team  (BCT)  formations. 
The  results  of  those  interviews  were 
used  to  integrate  human  decision 
making  into  analysis  that  underpinned 
the  Army’s  recent  brigade  combat 
team  transition  to  three-battalion 
BCTs  (Salmeron  and  Appleget,  2014). 
Today  the  US  Army  Center  for  Army 
Analysis  (CAA)  wargaming  capability 
provides  the  organization  with  a  true 
end-to-end  campaign  analysis  capa¬ 
bility  as  they  integrate  COA  developed 
through  wargaming  into  their  Joint 
Integrated  Contingency  Model  (JICM) 
combat  simulation.0 

One  of  the  significant  by-products 
of  recent  engagements  in  Iraq  and 
Afghanistan  has  been  the  experi¬ 
ence  analysts  have  gotten  as  they 
have  been  integrated  into  joint  and 
multinational  headquarters.  The  close 
partnership  formed  between  analysts 
and  planners  provides  a  template  for 
more  relevant,  comprehensive,  and 
collaborative  analytic  products  in  the 
future.  In  particular,  planners  have 
never  forgotten  the  usefulness  of 
wargaming,  and  wargaming  plays  a 


prominent  role  in  US  and  many  of  our 
allies’  operational  planning  processes. 
The  United  Kingdom’s  Defence  Sci¬ 
ence  and  Technology  Laboratory  (Dstl) 
created  a  computer-based  wargame 
called  the  Peace  Support  Operations 
Model  (PSOM),  which  was  used  in 
Afghanistan  to  wargame  the  Interna¬ 
tional  Security  Assistance  Force  (ISAF) 
campaign  plan  in  the  spring  of  201 1 . 

CAA  responded  to  commanders  in 
Iraq  and  Afghanistan  and  created  a 
wargaming  capability  that  allowed 
them  quick-turn  analysis  responding 
to  the  forward  deployed  analysts  in 
Multi-National  Force-lraq  (MNF-I)  and 
ISAF.  Today  CAA  is  building  a  strong 
reputation  for  wargaming  excellence 
recognized  by  COCOMs  by  sup¬ 
porting  PACOM  and  USARPAC  with 
wargaming  expertise. 

Conclusions 

As  the  demand  grows  and  more 
wargaming  is  sought,  it  is  clear  that 
the  skills  needed  to  design,  develop, 
conduct,  and  analyze  wargames  are 
not  well  known,  or  if  known,  not  well 
implemented.  There  are  still  many 
“wargames”  being  conducted  that  are 
little  more  than  BOGGSATs  (bunch  of 
guys  and  gals  sitting  around  a  table), 
as  evidenced  by  the  lack  of  useful 
wargaming  results  from  many  of  DoD’s 
higher  level  wargaming  events.  Other 
organizations  are  trying  to  recreate  our 
combat-simulation-heavy  pre-9/1 1 
wargaming  capability  by  collecting  and 
federating  existing  combat  simulations 
for  analysis.  They  seem  unaware  of  the 
scenario  and  data  challenges  today’s 
uncertain  world  presents. 

COCOM  planning  organizations  should 
partner  more  closely  with  analysts  from 
their  own  headquarters  and  from  other 
analytic  organizations.  Plans  should  be 
dusted  off,  reexamined,  and  updated, 
and  then  wargamed  periodically,  with 
planners  and  analysts  teaming  to  pro¬ 


duce  rigorous,  well  documented  and 
viable  plans. 

Peter  Perla’s  The  Art  of  Wargaming 
(US  Naval  Institute,  1 990)  is  a  great 
reference  that  sets  the  foundation  for 
modern  military  wargaming,  but  the 
book  is  nearly  a  quarter  of  a  cen¬ 
tury  old.  Since  then,  much  has  been 
learned  about  wargaming  that  needs 
to  be  collected,  triaged,  documented, 
and  published.  MORS  began  a  prese¬ 
quester  initiative  led  by  Scott  Simp¬ 
kins  of  the  Johns  Hopkins  Applied 
Physics  Laboratory  to  capture  what 
we’ve  learned  about  wargaming  that 
should  be  reinvigorated. 

Finally,  wargaming  education  needs  to 
be  embraced.  Although  US  doctrine 
mandates  that  our  planners  wargame, 
details  on  how  to  conduct  useful 
wargames  are  scarce  in  our  doctrinal 
literature.  Our  war  colleges  and  staff 
colleges  need  to  devote  more  time  to 
wargaming,  to  include  having  stu¬ 
dents  build  libraries  of  useful  wargam¬ 
ing  results  of  potential  future  conflicts, 
like  NWC  did  with  Plan  Orange.  All 
analysts,  including  civilian  analysts, 
should  take  a  course  in  wargaming. 

As  part  of  the  MORS  initiative  to  pro¬ 
vide  professional  development  to  OR 
practitioners,  a  component  should  be 
included  that  offers  the  skills  neces¬ 
sary  to  design,  develop,  conduct,  and 
analyze  professional  wargames. 

Notes 

a  We  have  purposely  included  plan¬ 
ning  wargames  under  the  heading  of 
“analytic  wargames”  because  plan¬ 
ning  wargames  are  wargames  that  are 
designed  to  produce  output  that  feed 
into  operational  decisions. 

b  Remarks  by  Dr.  Donald  C.  Winter, 
Secretary  of  Navy,  Current  Strategy 
Forum,  Naval  War  College,  Newport, 
Rhode  Island,  June  13,  2006. 
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c  Personal  communication  with  Dr.  Da¬ 
vid  Knudson,  CAA. 
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Practical  W&A 

for 

DIME/PMESII  Models 


Dean  S.  Hartley  III,  Hartley  Consulting 


The  Department  of  Defense 
(DoD)  requires  that  models 
and  simulations  (M&S)  un¬ 
dergo  verification,  validation, 
and  accreditation  (W&A). 

The  Modeling  &  Simulation 
Coordination  Office  (M&SCO)  provides 
voluminous  resources  concerning 
W&A,  including  an  excellent  descrip¬ 
tion  of  the  basics  (http://msco.mil/ 
WA_RPG.html).  However,  M&SCO 
must  attempt  to  cover  all  possible 
uses  of  M&S  by  DoD.  I  am  interested 
in  DIME/PMESII  models,  which  I 
define  below.  Further,  the  M&SCO 
resource  is  prescriptive,  rather  than 
descriptive.  I  have  had  more  than  40 
years  of  experience  in  practicing  veri¬ 
fication  and  validation  (V&V),  the  last 
10  of  which  have  involved  DIME/PME¬ 
SII  type  M&S,  and  I  am  uncomfortable 
with  some  prescriptions.  A  point-for- 
point  discussion  of  the  differences 
would  be  tedious.  Instead,  I  describe 
the  lessons  I  have  learned,  with  plenty 
of  references  at  the  end  for  further 
reading.  These  lessons  are  centered 
on  simulation  models.  I  address  more 
specialized  simulation  concerns, 
such  as  human-in-the-loop  models 
and  agent-based  models,  elsewhere 
(Hartley,  2014). 

Definitions 

The  DoD  Instruction,  DoDI  5000.61 
(DoD,  1996)  provides  the  basic  defini¬ 
tions  of  W&A : 


Figure  1.  Model  Building  Process 
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•  Verification  is  the  process  of 
determining  that  a  model  or 
simulation  implementation  and  its 
associated  data  accurately  repre¬ 
sent  the  developer’s  conceptual 
description  and  specifications. 

•  Validation  is  the  process  of 
determining  the  degree  to  which 
a  model  or  simulation  and  its  as¬ 
sociated  data  are  an  accurate  rep¬ 
resentation  of  the  real  world  from 
the  perspective  of  the  intended 
uses  of  the  model. 

•  Accreditation  is  the  official  certifi¬ 
cation  that  a  model  or  simulation 
and  its  associated  data  are  accept¬ 
able  for  use  for  a  specific  purpose. 

The  M&SCO  description  provides 
succinct  paraphrases:  “verification  — 
did  I  build  the  thing  right?”;  “valida¬ 
tion— did  I  build  the  right  thing?”;  and 
“accreditation— is  it  believable  enough 
to  be  used?” 

The  DIME  and  PM  ESI  I  acronyms  rep¬ 
resent  an  attempt  to  understand  the 
complexities  of  what  used  to  be  called 
operations  other  than  war  (OOTW) 
and  are  now  generally  contained  in 
irregular  warfare  (IW)  operations.  This 
effort  is  also  known  as  human  social 
culture  behavior  (HSCB)  modeling. 

The  acronyms  can  be  defined  as: 

•  Levers  of  power:  DIME  is  a  de¬ 
composition  of  what  can  be  done 
about  a  situation:  Diplomacy, 
Information,  Military,  Economic 

•  Metrics:  PMESII  is  a  decomposi¬ 
tion  of  the  state  variables  that 
describe  the  situation:  Political, 
Military,  Economic,  Social,  Infor¬ 
mation,  Infrastructure 

Some  decompositions  include  ad¬ 
ditional  elements,  depending  on  the 
authors’  views  and  experiences.  I  find 
it  convenient  at  times  to  refer  to  DIME+ 
and  PMESII+  as  shorthand  to  indicate 
that  the  “official”  acronyms  can  be 


modified.  These  decompositions  are 
models  of  the  underlying  concepts. 
Refinements  and  further  decomposi¬ 
tions  have  yielded  an  IW  ontology 
(Hartley  and  Lacy,  201 1 , 2013;  see  also 
http://home.comcast.net/~dshartley3/ 
IWMetricOntology/IWTotalOntology. 
htm)  that  has  proved  useful  to  the  US 
Army  TRADOC  Analysis  Center  (TRAC) 
and  for  W&A  of  DIME/PMESII  models 
(http://home.comcast.net/~dshartley3/ 
WATool/WA.htm). 

VV&A  Process 

The  DoD  has  and  continues  to  em¬ 
ploy  a  very  large  number  of  models 
and  simulations.  This  M&S  collection 
includes  several  types  with  distinct 
properties  with  regard  to  VV&A.  For 
example,  models  of  missile  flight 
permit  nearly  complete  V&V  because 
most  of  the  variables  have  very  strong 
physical-law  bases  (see  Hartley  et  al., 

1 990)  for  an  example  of  V&V  for  this 
type  model).  On  the  other  hand,  com¬ 
bat  models  and  DIME/PMESII  models 
must  rely  on  human  behavior  models, 
which  are  inherently  unreliable. 

Throughout  this  article,  I  will  be  high¬ 
lighting  important  lessons  learned  as 
the  first,  second,  etc.,  thing  to  know 
about  V&V.  Underlying  all  of  this  is 
the  zeroth  thing  to  know:  VV&A  is  not 
about  proving  a  model  right  or  wrong. 
It  is  a  risk  mitigation  process  involving 
understanding  the  model:  Did  I  build 
the  thing  right?  Is  it  believable  enough 
to  use?  The  risk  is  that  the  answers 
might  be  “no.”  Most  of  the  time  the 
answers  are  “sort  of”  and  “I  don’t 
know.”  The  risk  mitigation  involves 
discovering  as  much  as  possible 
about  the  model  to  figure  out  what 
can  be  done  to  improve  the  answers 
or  to  limit  the  use  of  the  model  to 
areas  where  the  answers  are  as  good 
as  can  be  achieved. 

To  find  out  where  the  risks  lie,  it  helps 
to  understand  the  process  of  creating 


a  model.  Figure  1  illustrates  the  pro¬ 
cess.  We  start  with  the  “real  world,” 
or  at  least  that  part  that  is  relevant 
to  the  model  we  wish  to  build.  Im¬ 
mediately,  we  realize  that  most  DIME/ 
PMESII  (PMESII  for  short)  values  are 
not  observable  in  the  real  world.  We 
can  get  some  things  from  the  real 
world;  however,  we  will  mostly  have  to 
work  from  a  proxy  for  it  or  a  percep¬ 
tion  of  the  real  world.  These  are  the 
“referents”  described  in  Appleget  et 
al.  (2011).  We  will  create  a  conceptual 
model.  (Note  this  diagram  leaves  out 
the  cyclical  nature  of  the  real  process 
for  simplicity.)  We  find  our  first  two 
risk  points  where  we  are  abstracting 
concepts  from  the  real  world  or  the 
proxy  to  create  the  conceptual  model. 

From  the  conceptual  model,  we  cre¬ 
ate  a  coded  model  with  the  attendant 
third  risk  point  of  incorrect  conversion 
of  the  concept  to  the  coded  model. 
Before  we  can  use  the  model,  we  will 
have  to  obtain  the  data  to  feed  it.  The 
fourth  and  fifth  risk  points  arise  from 
collecting  the  data.  Did  we  get  the 
correct  values?  Are  they  commensu¬ 
rate,  etc.?  The  sixth  risk  point  arises 
from  converting  the  data  for  use  by 
the  model.  Do  the  model’s  assump¬ 
tions  about  the  data  fit  the  definitions 
of  the  actual  data?  The  final  risk  point 
arises  when  we  use  the  model.  Are  we 
interpreting  the  results  correctly? 

Figure  2  shows  how  the  parts  of  V&V 
are  structured  to  address  these  risks. 
Risks  1  and  2  are  addressed  by  con¬ 
ceptual  model  (CM)  validation  and  the¬ 
ory  and  SME  validation  from  the  proxy. 
Risk  3  is  addressed  by  model  verifica¬ 
tion.  Risks  4  and  5  are  addressed  by 
data  validation.  Risk  6  is  addressed  by 
data  verification.  Risk  7  is  addressed 
by  model  validation  and  theory,  data 
and  subject  matter  expert  (SME) 
validation.  Notice  that  the  risks  that 
rely  on  this  last  validation  part  have  a 
problem:  the  arrow  does  not  extend 
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Figure  3.  System  Structure 


Figure  4.  The  W&A  Process  Flow 


fully  from  the  proxy  to  the  real  world. 
This  indicates  that  for  DIME/PMESII 
models,  we  don’t  know  enough  about 
the  way  the  real  world  works  to  know 
whether  what  we  did  was  right.  In 
this  figure,  the  risks  are  colored  blue, 
rather  than  red,  to  indicate  some  miti¬ 
gation;  however,  the  ovals  are  still  red 
to  indicate  that  at  any  given  point,  we 
still  have  more  to  do. 


Organizing  to  Perform  VV&A 
Versions 

The  first  thing  to  recognize  is  that 
you  don’t  do  W&A  on  model  “X.” 

“X”  is  just  a  label.  You  do  W&A  on  a 
particular  version.  Depending  on  the 
changes  from  one  version  to  another, 
the  results  from  the  W&A  work  on  the 
first  version  may  carry  over  with  no 
changes  to  the  next  version  or  may 
have  almost  no  application  to  the  next 


version.  Figure  3  illustrates  a  generic 
system  structure.  A  very  simple  model 
may  have  no  subpieces;  however, 
many  large  models  are  decomposed 
into  a  system/model/module  struc¬ 
ture,  with  each  piece  having  its  own 
version  number.  As  the  figure  shows, 
the  intramodel  and  intermodel  con¬ 
nections  are  actually  made  at  the 
module  level. 

Preparation 

The  second  thing  to  know  about  W&A 
is  that  proper  preparation  is  one  key 
to  successful  W&A  execution.  Figure 
4  illustrates  this  point  with  the  process 
flow  for  using  the  DIME/PMESII  W&A 
tool.  The  four  yellow  “perform”  boxes 
in  the  execution  phase  are  preceded 
by  1 2  preparation  boxes.  Other  W&A 
flows  may  differ  in  their  details;  how¬ 
ever,  my  experience  has  been  that  at 
least  four  weeks  of  preparation  are 
necessary  for  each  week  of  formal 
testing.  In  this  case,  the  tool  that  sup¬ 
ports  the  W&A  process  is  a  database 
system  that  will  produce  extensive 
documentation.  Accordingly,  it  re¬ 
quires  careful  definition  of  the  items 
that  will  be  used  in  the  process  and  in 
the  documentation.  The  preparation 
steps  include: 

•  Theories  with  validity  judgments 
will  be  linked  to  the  ontology-de¬ 
fined  parts  of  the  model  to  justify 
the  validity  judgments. 

•  Data  sources  with  validity  judg¬ 
ments  will  be  linked  to  the  parts  of 
the  model  for  similar  justifications. 

•  The  system,  based  on  versions, 
has  to  be  clearly  defined  so  that 
the  output  records  will  refer  to  the 
correct  system  version  and  so 
that  subsequent  W&A  processes 
can  use  prior  results. 

•  The  system  requirements  and 
functions,  upon  which  the  deci¬ 
sions  about  the  system  will  be 
based,  must  be  clearly  defined. 
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Figure  5.  Entrenched  W&A  Elements 
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Figure  6.  Applying  Entrenched  W&A 
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•  The  people  and  organizations 
involved  in  the  process  must  be 
defined  so  that  the  record  will 
clearly  show  who  did  what  and 
who  made  which  decisions. 

•  Each  test  event  (more  about  this 
later)  must  be  defined,  from  the 
tests  that  will  be  performed  (with  ex¬ 
pected  results)  to  the  physical  test 
station  and  the  schedule  of  testing. 
This  is  needed  to  ensure  that  all 

of  the  tests  can  be  carried  out  in 


the  allotted  time  with  the  available 
equipment  and  facility  layout. 

The  actual  execution  is  relatively  sim¬ 
ple,  subject  to  several  observations. 

First,  some  of  the  steps  do  not  require 
model  execution.  These  are  labeled 
“static”  tests: 

•  Conceptual  model  validation 
includes  identifying  the  theories 


upon  which  the  conceptual  model 
is  based  (addressing  risks  1  and  2). 

•  Coded  model  V&V  includes  judg¬ 
ing  the  quality  of  the  implementa¬ 
tion  of  the  theories  (addressing 
risks  3  and  7). 

•  Data  V&V  includes  identifying  the 
data  sources  used  by  each  mod¬ 
ule  and  judging  the  appropriate¬ 
ness  of  each  data  source  for  the 
module’s  modeling  assumptions 
(addressing  risks  4,  5,  and  6). 

Second,  a  major  part  of  the  V&V 
process  requires  model  execution. 

The  tests  within  this  step  are  referred 
to  as  “dynamic”  tests.  These  tests 
should  have  address  the  system  re¬ 
quirements  and  functions  (principally 
addressing  risk  3). 

Third,  the  test  evaluation  step  is 
partially  automated,  with  generated 
reports  that  present  the  results  graphi¬ 
cally  and  in  lists,  both  at  a  highly 
detailed  level  for  action  by  the  system 
owner  and  at  a  higher  level  for  execu¬ 
tive  view. 

Finally,  the  system  supports  record¬ 
ing  the  accreditation  decision,  with 
caveats  when  necessary. 

Entrenched  VV&A 

The  third  thing  to  know  about  W&A 
is  that  it  is  not  something  that  is  to  be 
tacked  on  upon  completing  the  M&S 
creation  work.  W&A  is  an  entrenched 
process  that  is  employed  throughout 
the  lifecycle  of  a  model. 

As  shown  in  Figure  5,  all  of  the  devel¬ 
opment  testing  should  be  understood 
to  be  part  of  the  W&A  process.  This 
testing  should  be  credited  as  V&V 
work.  In  addition,  any  time  something 
changes,  these  changes  should  trig¬ 
ger  additional  testing,  which  is  part 
of  the  process.  A  change  to  a  module 
should  cause  version  changes  for  the 
module,  its  containing  model,  and  the 
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Figure  7.  Simplified  Entrenched  W&A  Process  Flow 


system  as  a  whole— and  this  implies 
a  need  for  triggered  testing.  Periodic 
testing  presents  the  opportunity  to 
build  on  what  has  been  learned  dur¬ 
ing  previous  V&V  efforts.  Each  model 
use  also  presents  the  opportunity  to 
build  up  knowledge  about  the  mod¬ 
el— again  part  of  the  W&A  process. 
Finally,  accreditation  is  obviously  part 
of  the  W&A  process.  However,  in  the 
entrenched  process,  accreditation  is 
not  a  one-time  event,  but  one  that  oc¬ 
curs  as  needed. 

Figure  6  illustrates  the  repetition  of  the 
entrenched  W&A  elements  during  the 
course  of  a  typical  spiral  development 
cycle  and  into  the  time  of  use  of  the 
model.  Obviously,  the  triggered  test¬ 
ing  cannot  be  forecast  ahead  of  time; 
so  these  events  are  added  to  suggest 
random  occurrences. 

Another  way  of  looking  at  entrenched 
W&A  is  shown  in  the  flowchart  in 
Figure  7. 

This  figure  emphasizes  the  types  of 
events  that  engender  the  entrenched 
elements.  Code  changes  engender 


developmental  tests;  the  passage  of 
time  spawns  periodic  tests;  special 
events  cause  triggered  tests;  and 
using  the  model  leads  to  additional 
evaluations.  The  discovery  of  prob¬ 
lems  leads  to  the  need  to  manage  the 
risks.  Finally,  the  knowledge  gained 
supports  accreditation  decisions. 

Documentation 

The  fourth  thing  to  recognize  is  that 
the  W&A  process  must  be  document¬ 
ed.  Without  adequate  documentation, 
nothing  is  known  about  the  model. 
There  may  be  people  who  each 
know  something  about  the  model,  its 
qualities,  and  it  deficiencies;  however, 
people  move  on  to  other  projects,  tak¬ 
ing  their  knowledge  with  them.  Even 
people  who  stay  will  forget  some  of 
the  things  they  know. 

Everything  needs  to  be  documented, 
including  such  mundane  elements 
as  people  and  organizations  involved 
(with  roles)  and  dates  and  places  of 
testing.  Naturally,  the  details  of  each 
test,  with  conditions,  results,  and 
mitigation  plans,  must  be  recorded. 
Further  (remember  the  model-use 


“testing”),  all  significant  events 
that  occur  during  model  use  must 
be  recorded,  including  successes. 
When  performing  triggered  W&A, 
tests  must  be  divided  between  tests 
of  new  functionality  and  repeats  of 
tests  that  were  passed  by  the  old 
version  of  the  model.  This  requires 
knowing  what  tests  were  passed  and 
their  results. 

The  volume  of  data  generated  by  test¬ 
ing  any  moderately  large  DIME/PME- 
Sll  model  is  quite  large.  This  means 
that  the  data  must  be  organized  for 
ease  of  retrieval  so  that  it  can  be  actu¬ 
ally  be  used. 

V&VTechniques 

Most  of  the  individual  tests  that  can 
actually  be  performed  on  DIME/ 
PMESII  models  are  fairly  simple.  The 
problems  that  arise  come  from  the 
sheer  number  of  tests,  the  difficulty  in 
analyzing  and  presenting  the  results, 
and  using  the  data  from  previous 
testing.  Numerous  sources  discuss 
V&V  techniques  (notably  Knepell  and 
Arangno,  1993;  and  Balci,  2001).  It 
is  useful  to  know  about  these  tech¬ 
niques;  however,  less  than  a  third  of 
them  are  applicable  to  DIME/PMESII 
models,  which  simplifies  the  problem 
of  picking  techniques.  Figure  8  is  a 
version  of  the  list  from  Balci  (2001). 
The  techniques  that  are  readily  ap¬ 
plicable  to  most  DIME/PMESII  models 
appear  in  red  text. 

Practically  speaking,  there  is  never 
time  enough  to  do  all  the  testing  that 
might  be  useful.  This  fact  feeds  back 
into  the  concept  of  entrenched  W&A, 
with  thorough  documentation  to  en¬ 
sure  that  subsequent  testing  builds  on 
previous  testing. 

The  fifth  thing  to  know  about  the 
W&A  process  is  that  you  will  need  a 
system  to  organize  the  process.  This 
is  the  genesis  of  the  DIME/PMESII 
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Figure  8.  Standard  Test  Types 
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Figure  9.  W&A  Process  Maturity  Metric 
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VV&A  tool.  It  is  one  of  the  systems 
that  can  support  this  organizational 
need.  The  Navy  supplies  another 
tool  (mentioned  in  DoN,  2004).  When 
last  checked,  this  Navy  tool  was 
Web-based;  however,  the  model 
types  covered  were  much  more 
general  than  DIME/PMESII  models, 
resulting  in  many  input  requirements 
that  are  not  germane  to  DIME/PME¬ 
SII  models. 


Maturity 

Harmon  and  Youngblood  introduced 
a  Validation  Process  Maturity  Model 
(VPMM)  to  measure  the  maturity  of  the 
validation  process  (Harmon  and  Young¬ 
blood,  2005).  Figure  9  extends  this 
model  (indicated  by  the  text  in  red).  Note 
that  documentation  is  one  of  the  key 
areas  for  determining  process  maturity. 

This  figure  also  indicates  the  prob¬ 
able  level  of  most  current  DIME/PME¬ 


SII  VV&A  and  the  highest  probable 
achievable  level.  Many  DIME/PMESII 
models  are  at  level  1  or  0  because 
they  do  not  meet  all  the  criteria  for 
the  next  level.  Given  the  difficulties  as¬ 
sociated  with  the  social  theories  upon 
which  DIME/PMESII  models  must  be 
based,  many  of  the  level  4  criteria  are 
simply  not  achievable. 

The  sixth  thing  to  recognize  about  the 
DIME/PMESII  W&A  process  is  that 
the  results  will  not  be  as  complete  as 
the  results  for  physics-based  models. 
The  science  behind  DIME/PMESII 
models  is  not  mature. 

Conclusions 

W&A  for  DIME/PMESII  models  is 
possible;  however,  the  seven  points 
discussed  above  relative  to  such 
VV&A  must  be  reiterated: 

•  VV&A  is  not  about  proving  a 
model  right  or  wrong.  It  is  a  risk 
mitigation  process  involving  un¬ 
derstanding  the  model.  The  risk 
mitigation  involves  discovering 
as  much  as  possible  about  the 
model  to  figure  out  what  can  be 
done  to  improve  the  model  or  to 
limit  the  use  of  the  model  to  areas 
where  the  answers  are  as  good  as 
can  be  achieved. 

•  You  don’t  do  W&A  on  model  “X.” 
You  do  W&A  on  a  version. 

•  Proper  preparation  is  one  key  to 
successful  W&A  execution.  Expe¬ 
rience  says  that  at  least  four  weeks 
of  preparation  are  necessary  for 
each  week  of  formal  testing 

•  VV&A  is  not  something  that  is  to 
be  tacked  on  upon  completing 
the  M&S  creation  work.  W&A  is 
an  entrenched  process  that  is 
employed  throughout  the  lifecycle 
of  a  model. 

•  The  W&A  process  must  be 
documented.  Without  adequate 
documentation,  nothing  is  known 
about  the  model. 
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•  You  will  need  a  system  to  organize 
the  W&A  process.  The  problems 
that  arise  come  from  the  sheer 
number  of  tests,  the  difficulty 

in  analyzing  and  presenting  the 
results,  and  using  the  data  from 
previous  testing. 

•  The  results  of  the  DIME/PMESII 
W&A  process  will  not  be  as  com¬ 
plete  as  the  results  for  physics- 
based  models.  The  science 
behind  DIME/PMESII  models  is 
not  mature. 
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The  Challenge  of 

Integrated  Space  Analysis 

Jim  Muccio,  US  Air  Force 


n  March  2014,  on  the  eve  of  his 
retirement  from  his  position  as  the 
Navy  (USN)  Sponsor  to  the  Mili¬ 
tary  Operations  Research  Society 
(MORS)  and  the  Director  Assess¬ 
ment  Division  in  N81 ,  Mr.  Arthur  H. 
“Trip”  Barber,  wrote  an  article  in  the 
March  2014  Phalanx  entitled,  “Joint 
Warfare  Analysis:  The  Key  to  Shap¬ 
ing  DoD’s  Future.”  In  this  article  he 
presents  a  stunning  indictment  of  how 
the  Office  of  the  Secretary  of  Defense 
(OSD)  and  the  Joint  Staff  (JS)  have 
taken  the  DoD  analytic  community 
away  from  campaign-level  analysis. 
Prior  to  2012,  OSD  and  the  JS,  work¬ 
ing  with  the  Services  and  Combatant 
Commanders  (COCOMs),  led  efforts  to 
produce  baseline  campaign  analyses 
that  enabled  the  services  to  assess 
their  needs  in  the  context  of  a  joint 
environment  where  the  contributions 
from  other  players  were  represented 
reasonably.  OSD  and  the  JS  have  tak¬ 
en  us  in  reverse.  Mr.  Barber  specifical¬ 
ly  referenced  philosophical  differences 
in  the  ability  to  achieve  useful  results 
given  the  complexity  and  uncertainty 
of  analysis  conducted  at  this  level.  To 
paraphrase,  it’s  too  hard. 

We  stand  at  the  crossroads  with  the 
future  of  campaign-level  analysis 
hanging  in  the  balance.  Looking  into 
the  future,  the  decisions  that  both  the 
DoD  and  the  Services  will  make  be¬ 
come  even  more  complex,  with  a  level 
of  uncertainty  that  is  unparalleled  in 
DoD  history.  This  important  work  will 
only  become  harder.  As  we  struggle 
to  perform  joint  analysis  with  accurate 
representations  of  the  effectiveness 


of  our  combat  forces  with  enough  ac¬ 
curacy  to  make  force  structure  trades 
and  to  inform  decisions,  we  end  up 
neglecting  the  contributions  from  ISR 
force  structure  as  well  as  the  enabling 
contributions  coming  from,  or  mov¬ 
ing  through,  assets  on  orbit  above 
us,  namely  those  within  the  space 
domain.  Capturing  the  benefits  from 
the  effects  from  space  only  adds  to 
the  complexity  of  conducting  relevant 
joint  warfare  analysis  at  the  campaign 
level.  The  absence  of  an  ability  to  inte¬ 
grate  space  capabilities,  and  cyber  as 
well,  into  a  joint  integrated  war  fight¬ 
ing  campaign  has  been  recognized  for 
a  number  of  years. 

As  early  as  2010,  Gen  Robert  Kehler, 
the  AFSPC  Commander  at  the  time, 
and  Gen  Kevin  Chilton,  the  com¬ 
mander  at  USSTRATCOM,  noted  the 
deficiency  in  our  analytic  work  and 
appealed  directly  to  the  Chief  of  Staff 
of  the  United  States  Air  Force,  Gen 
Norton  Swartz.  The  result  was  a  task, 
originating  at  CORONA  (one  of  the 
USAF  Four  Star  Summits),  to  bring 
analysis  in  both  the  space  and  cy¬ 
ber  domains,  up  to  the  level  we  have 
conducted  analysis  of  the  air  domain 
for  decades.  Along  the  way  we  should 
correct  any  flaws  in  the  work  done 
within  the  air  domain  in  the  absence  of 
the  space  contributions.  Planning  was 
done,  a  roadmap  was  created,  and 
courses  of  action  were  proposed.  But 
the  resources  to  tackle  this  problem 
never  emerged,  in  part  because  the 
space  community  believes  it  is  above 
the  fight.  The  space  community  has 
remained  isolated  from  joint  integrated 


campaign  analysis  for  three  reasons. 
First,  as  mentioned,  it  is  difficult.  Any 
attempt  to  model  information  in  a  war 
fight  always  proves  elusive.  Second, 
the  contributions  of  space  are  larger 
and  more  contributory  to  the  strate¬ 
gic  posture  of  our  county  as  a  whole, 
rather  than  just  the  war  fighting  or 
shooting  aspects  of  the  war,  i.e.,  when 
hostilities  start.  It  is  argued  this  value 
will  not  be  captured  in  the  current 
methods  of  campaign  analysis  that  is 
used  by  all  three  services.  Third,  the 
space  community  believes  the  struc¬ 
ture  of  joint  integrated  war  fighting 
analysis  is  hopelessly  biased  in  favor 
of  the  other  domains.  Thus,  to  join 
this  integrated  analysis  is  to  acknowl¬ 
edge  that  space  will  never  have  the 
same  value  as  an  F-35  with  JASSM, 
for  instance.  It  is  argued  that  space  is 
shown  a  negative  bias  by  an  Air  Force 
dominated  by  individuals  who  prefer  to 
buy,  fly,  and  operate  aircraft.  In  reality, 
if  the  contributions  of  space  were  to 
be  accurately  represented  at  the  cam¬ 
paign  level  those  contributions  would 
be  readily  apparent. 

Meanwhile,  the  space  community 
struggles  with  major  complexities  of 
its  own.  In  the  face  of  an  increasing 
demonstration  of  threats  to  orbital 
regimes  from  potential  adversaries, 
words  like  “resilience,”  “disaggrega¬ 
tion,”  and  “space  campaign”  are 
thrown  about  fiercely  in  an  ongoing 
debate.  As  this  future  unfolds  and 
the  space  community  clamors  to 
be  funded  to  the  levels  necessary 
to  build  a  capability  to  mitigate  this 
threat  to  its  domain,  it  has  also  suc- 
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cessfully  convinced  proponents  from 
the  other  domains  to  believe  that  the 
threat  to  space  is  too  great,  thus,  they 
should  cast  off  any  reliance  on  space, 
and  be  funded  to  the  levels  necessary 
to  mitigate  their  own  vulnerabilities  in 
this  area.  For  instance,  new  technol¬ 
ogy  to  replace  military  reliance  on  our 
GPS  constellation  had  been  a  promi¬ 
nent  question  stemming  from  an  early 
effort  led  by  Air  Combat  Command  in 
2007  entitled,  “A  Day  without  Space.” 
Despite  a  somewhat  balanced  effort, 
the  outcome  of  this  study  served  as  a 
direct  poke  in  the  space  community’s 
eye  that  confirmed  a  bias  com¬ 
ing  from  the  combat  air  forces  that 
was  intuitively  felt.  Further,  it  caused 
some  in  the  space  community  to  ask 
with  sarcasm,  “Will  there  be  a  ‘Day 
without  Air’  study?”  In  recent  days, 
this  continuous  tension  prompted 
renewed  calls  for  a  separate  space 
service,  which  had  run  silent  for  nearly 
a  decade.  Both  of  these  issues  raised 
by  the  space  community  inhibit  its  full 
participation  in  the  discussion.  The 
issues  of  bias  the  community  raises 
can  be  solved,  I  believe,  with  consci¬ 
entious  and  accurate  analysis  at  the 
campaign  level. 

The  challenge  to  the  military  opera¬ 
tions  research  community  is  to  come 
together  as  a  single  enterprise  to 
solve  these  complex  issues  of  analy¬ 
sis.  The  space  community  is  right  to 
say  the  value  of  space  to  the  nation 
cannot  just  be  weighed  in  the  context 
of  a  war  fight  alone.  However,  it  is  not 
correct  that  capturing  the  contribu¬ 
tions  of  space  to  the  operational  war 
fight  is  not  a  valid  piece  of  information 
that  decision  makers  need  in  their  cal¬ 
culus.  Nor  should  they  be  fearful  that 


its  inclusion  in  the  war  fight,  if  accu¬ 
rately  represented,  would  not  show  a 
value  that  would  clearly  illustrate  how 
iron  (air  frames  and  munitions)  was 
traded  years  ago  in  favor  of  a  higher 
probability  of  kill,  ushered  in  by  the 
advent  of  precision  guided  weapons 
and  the  Global  Positioning  System. 

In  December  2014,  the  USAF  A9 
called  together  members  of  the  space 
analytic  community  (AFSPC,  USTRAT- 
COM,  AFMC,  ACC,  SMC,  and  others) 
to  take  a  hard  look  at  the  vision  of 
Gen  Kehler  and  Gen  Chilton,  and  their 
request  to  the  CSAF  back  in  201 0. 
This  forum  is  called  the  Strategic 
Space  Analysis  Senior  Leader  Sum¬ 
mit.  The  effort  will  attempt  to  get  the 
analytic  community  moving  back  in 
the  direction  of  integrating  space  into 
the  campaign  war  fight.  It  will  attempt 
to  solve  the  problems  of  bias,  in  both 
the  establishment  of  scenarios  to  sup¬ 
port  space  analysis  and  by  capturing 
the  effects  of  space  on  a  war  fighting 
campaign.  They  will  create  a  frame¬ 
work,  based  on  the  Modeling  and 
Simulation  (M&S)  pyramid  that  will 
allow  us  to  show  the  value  of  space 
across  all  phases  of  conflict,  including 
Phase  0,  ahead  of  actual  hostilities. 

OSD  and  the  Joint  Staff  are  correct 
that  the  complexity  and  the  resources 
required  for  this  work  are  large.  But 
to  stick  our  collective  heads  in  the 
sand  and  allow  decisions  and  trades 
to  be  made  strictly  within  a  service, 
capability, or  resource  stovepipe  be¬ 
cause  it  is  too  complex  or  too  uncer¬ 
tain,  is  to  not  engage  the  promise  of 
joint  warfare  analysis  as  the  important 
tool  described  by  Mr.  Barber.  Rather, 
our  analytic  legacy  will  be  reduced  to 


a  collection  of  simple  tools  that  con¬ 
firm  the  intuitive  bias  already  rampant 
in  our  stovepipe  acquisition  system. 
Mr.  Barber’s  challenge  to  the  commu¬ 
nity  should  be  answered.  We  need  to 
reinvigorate  our  joint  campaign  analy¬ 
sis  capabilities  and  double  our  efforts 
to  add  modeling  representations  of 
space  assets. 

Note:  The  views  and  opinions  ex¬ 
pressed  herein  are  those  of  the  author 
and  do  not  necessarily  reflect  the 
views  of  the  United  States  Air  Force. 
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Asking  the  Right  Question: 

Thoughts  on  Participating 

in  a  Professional  Dialogue 


Harrison  Schramm,  MORS  Vice  President,  Member  and  Societal  Services,  vpmss@mors.org 


MORS  special 

meetings  and  the 
annual  symposium 
present  our  mem¬ 
bers  the  opportu¬ 
nity  to  present  their 
work  to  other  members  of  the 
analytic  community  in  an  informal 
setting.  Several  years  ago,  I  was 
preparing  for  a  conference  to 
present  a  paper  that  I  had  spent 
a  lot  of  energy  on  that  was  nearly 
complete.  As  I  was  leaving  the 
office  for  the  airport,  one  of  my 
coauthors  said,  “I  hope  we  get 
some  good  questions.” 


ing  at  any  given  event,  asking 
good  questions  is  more  about  the 
health  of  the  entire  analytic  com¬ 
munity.  I’ve  had  a  few  experienc¬ 
es  on  both  sides  of  the  podium 
that  have  encouraged  me  to  put 
some  thoughts  on  the  table. 
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I  was  still  a  junior  analyst  and 
didn’t  quite  understand.  I  thought 
that  the  point  of  giving  a  pre¬ 
sentation  was  to  survive  the 
experience  and  get  off  the  stage 
without  having  to  answer  any 
questions  at  all,  save  perhaps 
minor  variations  on  “why  is  your 
work  so  awesome?”  Recently, 

I  have  realized  that  we  spend  a 
lot  of  effort  telling  people  how  to 
make  good  presentations— the 
transmission  side  of  communica¬ 
tion— but  we  may  not  be  giving 
appropriate  attention  to  what 
makes  good  questions— the 
feedback  part.  Although  focusing 
on  presentations  affects  the  part 
of  the  community  that  is  speak- 


Why  Do  People  Present  at 
Meetings? 

There  are  many  reasons  that 
people  present  their  work  at 
conferences  in  the  year  201 5, 
such  as  justifying  their  travel, 
advertising  their  work/methodol¬ 
ogy,  and  building  up  their  resume. 
But  the  real  reason  we  should  be 
doing  it  is  for  informal,  fast  peer 
review.  This  important  step  in  the 
research  process  precedes  formal 
review,  either  by  referees  or  cus¬ 
tomers.  Questions  from  the  audi- 
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ence  are  a  core  reason  to  have 


public  expositions  of  our  work. 
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Raising  a  question  during  a 
session  makes  the  asker  an 
uninvited  coauthor.  When  done 
properly,  it  aids  the  presenter 
with  constructive  information 
and  both  improves  and  broadens 
the  work.  When  done  poorly,  it 
“barges  in”  on  the  presentation. 

If  you  are  going  to  commit  to 
stealing  some  of  the  presenter’s 
spotlight,  you  should  do  it  well. 
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What  Makes  a 
Good  Question? 

In  my  opinion,  a  good  question  ac¬ 
knowledges  the  effort  and  contribution 
of  the  author  and  helps  push  the  dialog 
forward  among  the  community  writ 
large.  Be  aware  that  in  asking  you  are 
communicating  both  your  professional 
knowledge  and,  more  importantly,  your 
quality  as  a  colleague.  A  good  question 
should  accomplish  two  things: 


•  It  should  help  further  the  research 
of  the  presenter,  and  the  session 
at  large. 

•  It  should  demonstrate  that  the 
asker  understands  the  topic  at 
hand  and  has  paid  attention  dur¬ 
ing  the  discussion.  When  asked 
in  public,  a  question  should  be  of 
interest  to  more  than  the  asker. 

Good  questions  should  be  techni¬ 
cally  based  without  dwelling  on 
technical  details,  and  hard  without 
being  unkind. 
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Just  because  you  can  ask  a  question 
doesn’t  mean  that  you  should.  With 
respect  to  questions,  presentations 
broadly  fall  in  three  categories.  First, 
a  presentation  can  be  so  airtight  that 
there  aren’t  any  meaningful  ques¬ 
tions  to  ask.  This  is  rare,  because 
most  presenters  are  showing  work 
in  progress.  At  the  other  extreme,  a 
presentation  can  be  so  bad  that  there 
are  lots  of  holes  in  the  work.  In  this 
case  it  is  difficult  to  come  up  with  a 
productive  question  to  ask,  and  it  is 
better  off  not  to  ask  anything  at  all. 
The  third  possibility  is  that  the  pre¬ 
sentation  is  of  good  quality  overall, 
are  some  minor  “threads” 
Here  is  where  the  interaction 
the  presenter  and  the  audi- 
can  be  most  useful. 


akes  a  Bad  Question? 

defining  trait  of  a  bad  question  is 
* v  rudeness,  and  the  overarching  rule  for 

K  audience  members  is  don’t  be  rude 
in  public.  It  is  possible  to  be  techni¬ 
cally  challenging  without  being  rude. 
Conversely,  it  is  possible  to  be  rude 
while  carryingpto  substantive  content. 
Some  of  the  most  common  ways  to 
be  rude  are: 


•  Hijacking  the  question-and- 
answer  period  to  give  your  own 
minipresentation.  If  the  setup  to 
your  question  takes  more  than 


two  minutes  or  requires  mul¬ 
tiple  references  to  materials  not 
covered  by  the  speaker,  you  are 
probably  crossing  the  line  be¬ 
tween  asking  about  a  presentation 
and  giving  your  own.  The  warn¬ 
ing  signs  that  you  are  doing  this 
include  other  attendees  checking 
their  watches  and  the  speaker 
or  chair  responding  with  “I  don’t 
think  that  was  a  question.” 

•  Overly  dwelling  on  technical  detail. 
This  is  when  you  give  the  impres¬ 
sion  that  you  are  getting  ready 

for  a  “nerd  off”  with  the  speaker. 
Technical  questions  are  good  and 
proper,  but  in  public  they  should 
not  be  strictly  for  technicality’s 
sake.  The  technical  point  raised 
should  substantially  affect  the 
outcome  of  the  analysis.  Lesser 
technical  points  are  best  raised  in 
private  afterward  (see  below). 

•  A  question  that  is  driven  by  per¬ 
sonal  or  organizational  differences 
is  always  rude.  Open  forums  are 
not  appropriate  for  airing  griev¬ 
ances  against  another’s  person¬ 
ality,  method,  or  institution.  It  is 
the  job  of  the  organizers  to  vet 
participants,  and  if  you  really  have 
that  much  of  a  disagreement,  this 
is  a  discussion  to  have  with  the 
chair  afterwards. 

When  to  Ask  Questions 

Finally,  I’d  like  to  address  the  appro¬ 
priate  time  to  ask  questions.  There  are 
three  times  that  people  ask  questions 
during  a  presentation,  listed  in  order 
from  most  to  least  disruptive. 

•  During  the  presentation,  or  the 
“ambush”  question.  This  is  ac¬ 
ceptable  only  if  the  or  chair  or 
speaker  indicates,  vocally  or  by 
body  language,  that  it’s  okay. 

•  During  the  Q&A  period  immedi¬ 
ately  following  the  session.  If  there 
is  more  than  one  hand  up  during 
the  question  period,  take  a  quick 
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second  and  ask  yourself  if  anyone 
other  than  you  will  be  interested  in 
the  discussion.  If  not,  you  should 
probably  ask  the  question  private¬ 
ly  after  the  presentation. 

•  In  private  afterward,  in  person 
or  via  email.  If  there’s  a  problem 
with  slides,  or  methodology,  or 
after  viewing  the  work  you  want 
to  delve  into  technical  points,  an 
email  afterward  is  a  good  mecha¬ 
nism  for  sharing  your  concerns. 
This  allows  the  feedback  to  be 
given  without  causing  embar¬ 
rassment  for  either  the  speaker 
or  yourself.  The  speaker,  and  the 
community  writ  large,  will  think 
that  you  are  a  well-behaved  ana¬ 
lytic  citizen. 

Special  Situations 

Before  concluding,  I’d  like  to  address 
two  special  situations. 

•  If  you  are  chairing  a  session, 
you  should  be  prepared  to  ask  a 
question  if  none  of  the  audience 
members  do.  This  prevents  five 


minutes  of  awkward  silence  where 
the  speaker  wonders  if  anyone 
was  actually  listening. 

•  First  question  in  a  large  setting 
where  you  are  relatively  senior.  In 
this  circumstance,  your  question 
sets  the  tone  for  the  rest  of  the 
discussion,  and  requires  a  little 
bit  of  forethought.  Your  question 
will  set  the  tone,  and  encour¬ 
age— or  possibly  derail— the  rest 
of  the  discussion. 

Finally,  if  you  find  yourself  needing  to 
ask  a  question  but  unable  to  think  of  a 
good  one,  I  find  computational  com¬ 
plexity  and  runtime  are  almost  always 
safe  and  interesting.  Either  the  solution 
is  fast  and  allows  the  speaker  to  high¬ 
light  how  elegant  his  or  her  method  is, 
or  it  is  slow  and  complex,  and  allows 
the  speaker  to  talk  about  how  he  or 
she  overcame  those  challenges. 

Feel  free  to  email  me  some  ques¬ 
tions  about  asking  good  questions  at( 
vpmss@mors.org. 


IN  TOUCH 


MORS  Heritage 

As  we  continue  the  countdown  to  the  50th  Anniversary  of  MORS,  we  would  like  to  revisit  our  proud  history  and  highlight 
the  past  leaders  of  the  Society  and  key  accomplishments  over  those  years.  Each  edition  of  Phalanx  will  provide  insight 
into  several  years  of  history.  Enjoy  reading  about  these  individuals  and  what  they  have  accomplished.  More  information 
on  the  Past  Presidents  (PP)  can  be  found  on  the  MORS  website,  including  their  oral  histories. 

Elected  Directors  (consolidated  list  2005-2007) 


Dr.  Patrick  Allen 

Michael  Garrambone 

Dr.  Willie  McFadden,  III,  FS 

Lt  Col  Andrew  Armacost 

Dr.  Niki  Goerger 

Lana  McGlynn 

Donald  Bates 

Debra  Hall 

Dr.  Gregory  McIntyre 

Col  (s)  Suzanne  Beers,  FS 

Dr.  Richard  Hayes 

Terry  McKearney 

Dr.  Ted  Bennett  Jr. 

Robert  Holcomb 

Patrick  McKenna,  FS 

Joseph  Bonnet 

Timothy  Hope 

Kirk  Michealson,  FS 

Mary  T.  Bonnet 

Susan  Iwanski,  FS 

Anne  Patenaude,  FS 

Dr.  W.  Forrest  Crain 

Jack  Keane,  FS 

Dr.  Steven  Pilnick 

Col  Gerald  Diaz 

Gregory  Keethler,  FS 

Mark  Reid 

Lawrence  Dick,  FS 

Jane  Krolewski 

Edward  “Ted”  Smyth,  FS 

William  Dunn,  FS 

William  Kroshl 

Cortez  Stephens 

Helaine  Elderkin,  FS 

LTC  Michael  Kwinn 

Lt  Col  Peter  Vanden  Bosch 

Dr.  Karsten  Engelmann 

Trena  Lilly 

Eugene  Visco,  FS 

John  Ferguson 

Dr.  Andrew  Loerch,  FS 

Corinne  Wallshein 

PaC%05-2007 


Sponsors 

US  Army 

Deputy  Under  Secretary  of  the  Army 
(Operations  Research) 

Mr.  Walter  W.  Hollis,  FS 
Sponsor’s  Rep:  COL  Hoa  Generazio 

US  Navy 

Director  Assessment  Division,  OCNO  (N81) 

Mr.  Arthur  Barber 

Sponsor’s  Rep:  Mr.  Herbert  Cupo 

US  Marine  Corps 

Marine  Corps  Combat  Development  Center 
Dr.  George  Akst 

Sponsor’s  Rep:  Col  Gregory  Reuss 


The  Joint  Staff 

Director  for  Force  Structure,  Resources  and  Assessment  (J8) 

VADM  Evan  Chanik 

Sponsor’s  Rep:  Mr.  Robert  Orlov 

US  Air  Force 

Director  Air  Force  Studies  and  Analyses  Agency 
Dr.  Jacqueline  Henningsen,  FS 
Sponsor’s  Rep:  Mr.  Royce  Reiss 

Office,  Secretary  of  Defense 

Director,  Program  Analysis  and  Evaluation 
Mr.  Eric  Coulter 

Sponsor’s  Rep:  Mr.  James  Bexfield 


MORS  Staff 

Brian  Engler,  FS, 

Executive  Vice  President 
Natalie  S.  Kelly, 

Vice  President,  Administration 
Cynthia  Kee, 

Administrator 


Corrina  Ross-Witkowski, 
Communications  Manager 
Colette  Burgess, 
Administrative  Assistant 
Helaine  Elderkin,  FS, 

Counsel 


Col  John  Andrews,  USAF, 
Editor,  Phalanx 
Dr.  Richard  Deckro, 

Editor,  Military  Operations 
Research  (MOR)  Journal 
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Significant  Events 

August  2002:  MORS  President, 
Edward  Smyth,  represented  MORS  at 
the  19th  International  Symposium  of 
Military  Operational  Research  (ISMOR) 
conducted  at  Eynsham  Hall  near 
Oxford,  UK.  In  addition  to  briefing  IS¬ 
MOR  on  MORS  activities,  an  invitation 
was  extended  for  ISMOR  members 
to  publish  in  Phalanx  and  to  attend 
unclassified  MORS  special  meetings. 

2002:  MORS  also  gained  permission 
from  UK  officials  to  republish  a  book 
entitled  Operational  Research  in  the 
RAF  as  another  volume  in  the  MORS 
Heritage  Series  of  publications. 

September  2002:  The  MORS  office 
moved  from  the  Duke  Street  location 
to  the  office  suite  on  N.  Beauregard 
Street. 

2002:  The  Educational  Forum  went 
“on  the  road”  for  the  first  time.  It  was 
held  at  the  Naval  Postgraduate  School 
(NPS)  with  a  number  of  West  Coast 
civilian  schools  in  attendance.  Mike 
Garrambone  served  as  the  program 
chair  for  the  event  that  featured  a 
team  competition  for  students  in  at¬ 
tendance. 


2002-2003:  Formed  an  ad  hoc  com¬ 
mittee  of  the  Board  of  Directors  (BoD) 
under  the  leadership  of  Lana  McG- 
lynn  to  review  the  existing  Compos¬ 
ite  Group/Working  Group  structure. 
Changes  to  the  structure  were  imple¬ 
mented  during  the  72nd  MORSS  in 
2004. 

2002-2003:  MORS  BoD  members 
were  tasked  with  reviewing  and  rec¬ 
ommending  changes  to  the  MORS 
Electronic  Media  Committee  to 
expand  MORS  interactions  with  the 
rapidly  expanding  suite  of  desktop 
and  laptop  automation  capabilities  of 
MORS  members. 

2002-2003:  Implemented  the  Spon¬ 
sor  Hot  Topics  segment  of  the  annual 
Symposium  beginning  with  the  71st 
MORSS. 

2003:  Implemented  the  Sponsor’s 
Corner  in  Phalanx  in  which  the  MORS 
sponsors  write  articles  on  various  top¬ 
ics,  starting  with  Jackie  Henningsen  in 
June  2003. 

74th  MORS  Symposium,  United 
States  Air  Force  Academy,  Colorado 
Springs,  June13-15,  2006.  40  years 


Foundation  for  the  Future.  Lawrence 
L.  Dick  and  Susan  M.  Iwanski  were 
inducted  as  Fellows  of  the  Society.  Dr. 
Roy  E.  Rice,  FS  received  the  Wanner 
Award.  Stephen  J.  Balut  received  the 
Thomas  Award.  David  Briggs  received 
the  Walker  Award.  Donald  Buckshaw, 
Dr.  Gregory  Parnell,  FS,  Willard  Un- 
kenholz,  Donald  Parks,  James  Wall- 
ner,  and  O.  Sami  Saydjari  received  the 
MOR  Journal  Award. 

75th  MORS  Symposium,  US  Na¬ 
val  Academy,  Annapolis,  Maryland, 
June  12-14,  2007.  Through  Multiple 
Disciples,  Analytical  Power.  Royce  H. 
Reiss  and  Dr.  Cyrus  J.  Staniec  were 
inducted  as  Fellows  of  the  Society. 
Walter  W.  Hollis,  FS,  received  the 
Wanner  Award.  Jerome  J.  Bracken 
received  the  Thomas  Award.  Gregory 
Boylan,  Bobbie  L.  Foote,  and  Roger 
Burk  received  the  Walker  Award  for 
their  article,  “Loitering  Aircraft  as  a 
Capability  Added  for  Anti-Ballistic 
Missile  Systems”  Phalanx,  Volume  39, 
Number  1 .  Dr  Patrick  J.  Driscoll  and 
MAJ  Steven  J.  Henderson  received 
the  MOR  Journal  Award. 


MORS  Presidents 

40th  MORS  President:  Suzanne  Beers,  2005-2006 


Suzanne  Beers  served  as  Secretary  in  2001-2002,  Vice  President  for  Meeting  Operations  in 
2002-2003,  Vice  President  for  Finance  and  Management  in  2003-2004,  and  President-Elect  in 
2004-2005.  She  served  as  MORS  President  from  2005-2006.  She  was  elected  as  a  Fellow  of  the 
Society  in  2010. 

Dr.  Beers  holds  BS  degrees  in  physics  from  Miami  University  and  mechanical  engineering  from 
the  Ohio  State  University,  an  MBA  from  New  Mexico  Highlands  University,  an  MS  in  electrical 
engineering  from  the  New  Mexico  State  University,  and  a  PhD  in  electrical  engineering  from  the 
Georgia  Institute  of  Technology. 


Dr.  Beers  is  a  retired  United  States  Air  Force  Colonel.  She  was  Commander,  US  Air  Force  Operational  Test  and  Evalua¬ 
tion  Center’s  Detachment  4.  During  her  Air  Force  career,  Dr.  Beers  held  assignments  in  which  she  developed  and  inte¬ 
grated  cruise  missiles;  operationally  tested  and  evaluated  cruise  missiles,  satellites,  and  space  control  centers;  analyzed 
space  systems;  operated  ground-launched  cruise  missiles;  and  led  groups  in  acquisition,  operations,  and  testing. 
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Dr.  Beers  joined  the  MITRE  Corporation  in  Colorado  Springs,  Colorado  in  2008,  supporting  DOT&E’s  Space  and  Net- 
Centric  Systems.  In  2009,  she  began  working  in  support  of  DASD(DT&E)  to  help  improve  how  DoD  conducted  Develop¬ 
mental  Test  and  Evaluation.  She  developed  the  Developmental  Evaluation  Framework— a  means  to  focus  DT&E  strategy 
development  on  evaluating  the  system  and  informing  decisions.  The  DEF  idea  has  been  adopted  by  DASD(DT&E)  as 
the  means  to  implement  the  Shift  Left  initiative,  to  meet  OSD/AT&L  Better  Buying  Power.  She  was  recently  selected  as 
MITRE  T&E  Portfolio  Manager,  responsible  for  managing  MITRE’s  OSD  T&E  business  portfolio. 

41  st  MORS  President:  Patrick  McKenna,  2006-2007 

Mr.  Patrick  McKenna  served  as  Vice  President,  Professional  Affairs  in  2003-2004,  Vice  President 
for  Meeting  Operations  in  2004-2005,  and  President-Elect  in  2005-2006.  He  was  President  of 
MORS  in  2006-2007and  was  elected  a  Fellow  of  the  Society  in  2009. 

Mr.  McKenna  earned  a  bachelor’s  of  science  degree  in  industrial  and  management  systems  en¬ 
gineering  from  North  Dakota  State  University  and  a  master’s  of  science  in  industrial  and  systems 
engineering  from  the  University  of  Nebraska,  Lincoln. 

Mr.  McKenna  is  currently  senior  advisor  to  USSTRATCOM’s  J5  Plans  and  Policy  Group.  He  has 
served  as  the  chief  of  the  Capabilities  Analysis  Branch,  Analysis  Management  Division,  Resource  and  Requirements 
Directorate  United  States  Strategic  Command. 

Mr.  McKenna  has  received  numerous  awards  during  his  career,  including  Air  Force  Civilian  Analyst  of  the  Year  (1998)  and 
the  Joint  Meritorious  Civilian  Service  Award  (2004). 
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MORS’  Young  Analysts 

the  Next  Generation  of  leaders 


The  future  of  operations  research 
and  the  national  security  community 
depends  on  new  analysts  taking  the 
helm.  MORS’  Young  Analyst  Initiative 
facilitates  this  process  by  providing 
paths  for  emerging  analysts  to  engage 
with  MORS  through  publishing, 
meeting  participation,  volunteering, 
mentorship  and  recognition. 


Alexander  trempe 


What  was  your  childhood  ambition? 

As  a  child/teenager  I  had  two  completely  dif¬ 
ferent  goals  for  my  future  career:  to  become 
an  orthopedic  surgeon,  or  a  spy  Given  my 
history  of  sports  injuries  I  was  drawn  to  the 
doctors  who  helped  patch  me  up  and  allow 
me  to  get  back  to  athletics  as  quickly  as  pos¬ 
sible.  I  thought  that  it  would  be  fun  and  inter¬ 
esting  to  be  able  to  provide  a  similar  service  to 
people  in  the  future.  The  fact  that  my  doctor 
drove  a  Lamborghini  didn’t  hurt  either.  My  other  dream  to  be  a  spy  was  borne 
from  the  countless  fiction  books  I  read  by  authors  like  Tom  Clancy  and  Robert 
Ludlum.  I  liked  to  envision  myself  working  to  defeat  the  adversaries  of  the  United 
States  across  the  world.  Its  somewhat  amusing  then,  that  in  the  end  I  find  myself 
in  a  field  where  my  daily  actions  ensure  that  the  US  Navy  has  the  investments 
necessary  to  provide  future  security  around  the  world. 


To  highlight  the  achievements,  interests 
and  aspirations  of  young  analysts,  we 
turn  the  spotlight  on  one  deserving 
individual  in  every  issue  of  Phalanx. 

To  learn  more  about  the  Young  Analyst 


Why  did  you  become  an  operations  analyst? 

I  began  my  professional  career  as  a  junior  analyst  specializing  in  campaign 
modeling  and  simulation.  I  quickly  realized  that  I  was  more  interested  in 
applying  analytic  techniques  to  the  data  and  results  from  the  modeling  rather 
than  puzzling  my  way  through  methods  and  techniques  to  instantiate  objects 
in  the  model.  It  was  at  this  point  that  I  began  to  increase  my  analytic  train¬ 
ing  and  experience.  I  focused  on  methods  to  easily  incorporate  quantitative 
values  to  senior  leaders.  It  is  thrilling  for  me  to  tease  out  insights  from  data 
that  then  further  advances  the  goals  of  the  Navy. 


Initiative,  connect  with  other  young 
analysts,  see  past  featured  analysts 
and  learn  how  you  can  nominate  a 
deserving  analyst,  please  visit 

WWW.MORS.ORG/YA 


Where  do  you  see  yourself  in  five  years? 

Using  my  operations  research  skills,  and  my  experience  as  a  Navy  analyst,  I  be¬ 
lieve  that  I  can  step  into  a  senior  leadership  role  within  the  Navy  or  the  Depart¬ 
ment  of  Defense  within  the  next  five  years. 

How  has  MORS  benefited  you?  What  do  you  value  most  about  your  experiences 
with  the  Society? 

Although  I  am  not  currently  a  member  of  MORS,  my  association  with  the 
Society  has  been  extremely  beneficial.  I  have  attended  multiple  MORS  sympo¬ 
siums  over  the  years  and  had  the  opportunity  to  present  some  of  my  work  at  the 
2014  symposium.  The  exchange  of  ideas,  insights,  and  analysis  techniques  at 
the  MORS  symposium  has  been  invaluable  to  my  development  as  an  operations 
research  professional. 
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THINKING  ANALYTICALLY 

John  Toczek 


(Doi 


$0.11 


Rearrange  the  coins  above 


so  that  the  sums  of  the  coins 


across  the  rows  and  down 


the  columns  match  the  dollar 


amounts  shown. 


Question:  In  what  order  do  the  coins  need  to  be  to  solve  the  puzzle? 


Send  your  answer  to  puzzlor@gmail.com  by  April  15,  2015.  The  winner, 
chosen  randomly  from  correct  answers,  will  receive  a  $25  Amazon  Gift 
Card.  Past  questions  can  be  found  at  puzzlor.com. 


John  Toczek  is  the  Sr.  Director  of  Decision  Support  and  Analytics  for  Aramark  Corporation  in  the  Global  Opera¬ 
tional  Excellence  group.  He  earned  his  BSc.  in  chemical  engineering  at  Drexel  University  (1996)  and  his  MSc  in 
operations  research  from  Virginia  Commonwealth  University  (2005). 
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Memb"Mi  estones 


Andrew  W.  “Andy”  Marshall  retired 
January  2,  2015,  from  his  position  as 
the  Director  of  Net  Assessment  in  the 
Office  of  the  Secretary  of  Defense.  Mr. 
Marshall  founded  the  Office  of  Net  As¬ 
sessment  in  1973  and  was  known  for 
his  “out  of  the  box  thinking”  on  hard 
topics.  His  advice  was  heeded  by 
Secretaries  of  Defense  for  more  than 
five  decades.  Mr.  Marshall  received 
the  MORS  Vance  R.  Wanner  Memorial 
Award  in  2010.  His  oral  history  will  be 
published  in  the  MOR  Journal,  Volume 
20,  Number  1  (see  http://www.mors. 
org/Publications/MOR-Journal). 

Four  long-time  members  of  MORS 
have  been  selected  as  Fellows  of  the 
Society  by  the  Board  of  Directors 
at  the  December  meeting.  They  are 

Arthur  H.  (Trip)  Barber,  Dr.  John  R. 
Hummel,  Lana  E.  McGlynn,  and  Ter¬ 
rance  J.  (Terry)  McKearney.  Look  for 
more  information  on  these  new  Fel¬ 
lows  and  the  role  of  Fellows  in  MORS 
on  page  9. 

Kirk  Michealson,  FS,  was  invited  to 
a  VIP  tour  of  the  Golf  Channel  by  the 
research  director,  who  is  responsible 
for  the  channel’s  business  analysis 
functions.  The  Golf  Channel  was  cele¬ 
brating  its  20th  anniversary  during  the 
visit  and  asked  Kirk  to  be  part  of  its 


photomontage  for  the  “Morning  Drive” 
show.  The  accompanying  photo  sub¬ 
stantiates  this,  so  we  know  it’s  not  just 
another  false  golfer’s  claim. 


Kirk  Michealson,  FS,  is  a  new  star  on  the  Golf  Channel. 


Ben  Taylor  of  the  Defence  Research 
and  Development  Canada/Centre  for 
Operational  Research  and  Analysis 
(DRDC/CORA)  is  now  the  Canadian 
representative  to  MORS  Board  of 
Directors,  replacing  Dr.  Roy  Mitchell. 
Ben  has  served  in  the  British  Minis¬ 
try  Defence  as  well  as  the  Canadian 
government. 

MORS  President  Dr.  Raphael  Matos 
has  been  again  invited  as  guest  lec¬ 
turer  of  the  Mathematics  Department 
of  the  Indiana  University  of  Pennsyl¬ 
vania  (IUP)  in  February.  He  will  be  pre¬ 
senting  two  workshops  on  effective  vi¬ 
sual  presentation  of  data  entitled,  “Do 
you  SEE  what  I’m  SAYING.”  These  will 
take  place  on  February  27  at  the  IUP. 


Gene  Visco,  FS,  keeps  busy  on  the 
lecture  circuit,  presenting  two  “brown 
bag”  talks  in  December  and  January. 

In  December,  he  addressed  the  MORS 
War  Gaming  Community  of  Practice 
(COP)  on  Schnellspiel,  a  hand-played 
war  game  he  built  in  1963  for  NATO’s 
Central  Army  Group.  In  January,  Gene 
spoke  to  the  Lockheed  Martin  Opera¬ 
tions  Analysis  COP  on  “How  Opera¬ 
tional  Research  Crossed  the  Pond 
and  Became  Operations  Research,” 
a  topic  he  covered  in  a  Phalanx  a  few 
months  ago). 

Dr.  Richard  Goodwin  will  receive 
the  Silver  Beaver  award,  the  highest 
award  that  the  Boy  Scouts  of  America 
bestows  on  its  adult  leaders  in  March. 
The  award  was  introduced  in  1931 
and  is  given  to  adult  Scout  leaders 
who  have  made  an  impact  on  the 
lives  of  youth  through  service  given  to 
the  council.  Dr.  Goodwin  will  receive 
this  honor  as  a  long-standing,  life¬ 
long  supporter  of  scouting  programs 
and  for  his  “extraordinary  leadership 
and  cheerful  service.”  at  all  levels 
of  Scouting  in  Councils  such  as  the 
National  Capital  Area  Council,  Mid 
America  Council,  and  Greater  Ala¬ 
bama  Council. 


50 


PHALANX 


MARCH  2015 


BE  A  R 


w» 


..if 


*  r\ 

t 


Join  the  World  of 
Certified  Analytics 
Professionals  (CAP®) 

i  A  M 

Top  5  Reason  ^ 


orms 


Certification  demonstrates  commitment  to  a  profession.  Earning  a  CAP®  credential  shows  your  peers, 
supervisors,  clients,  and  the  general  public  your  commitment  to  analytics  and  your  ability  to  perform 
to  accepted  standards. 

Certification  enhances  the  profession.  CAP®  exists  to  grow,  promote,  and  develop  analytics  professionals 
and  ensures  the  public  that  analytics  is  a  true,  time-honored  profession. 

Certification  reflects  personal  achievement.  Earning  your  CAP®  shows  the  world  you  will  not  stop  learning 
and  will  continuously  improve  your  performance  in  analytics. 


Certification  establishes  professional  credentials.  CAP®  recognizes  an  individual's  accomplishment  and 
stands  out  on  an  individual's  resume  or  a  company's  prospectus. 


Certification  improves  career  opportunities  and  advancement.  CAP®  is  a  clear  identifier  of  those  who  seek 
knowledge  of  changes  in  the  work,  technology,  business  practices,  and  innovation. 


Studies  show  that  those  who  hold  a  professional  certification  like 
CAP®  earn  more  over  their  career  than  peers  who  are  not  certified 


t.  Join  the  Analytics  Revolution. 


Email  us  at  certification@informs.org  with  any  questions  you  may  have. 
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The  Pseudo-Analytical  Agenda 

Saved  by  the 

Or,  How  One  Family  Cured  Their 
Dysfunctions  through  Reference  Architectures 


Eliza:  Hi,  I’m  Eliza  Faddish  reporting 
for  Channel  2.02.  I’m  here  today  with 
the  deFunk  family,  who  have  an  inter¬ 
esting  story  about  how  systems  engi¬ 
neering  helped  them  get  it  together. 

Fred  Actually,  I’d  say  we  just  weren’t 
achieving  our  Desired  Effects! 

Betty:  I’ll  say!  No  visions  or  measures 
...we  couldn’t  even  agree  on  our  as- 
is  Organizational  Activity  Model! 


daughter  Wilma,  and  little  Fred  Jr. 

Wilma  W.  Not  Wilma.  I’m  now  a 
performer  and  I’ve  declared  a  Person 
Type  with  a  defined  role  with  respect 
to  the  Architecture.  As  such,  I  am  now 
called  “W.” 

Eliza:  Well  thank  you  ...  W.  Maybe 
you’d  like  to  start  as  to  how  your  fam¬ 
ily  came  to  embrace  this  new  way  of 
doing  things? 


about  who  should  take  out  the  garbage 
and  why  I  shouldn’t  be  allowed  to  plug 
in  my  earbuds  at  the  dinner  table.  And 
Fred  Jr.’s  room  was  a  disaster— again. 

Fred  Jr.:  That’s  not  fair!  We  decided 
that  I  was  never  given  enough  training 
on  the  Zachman  Framework  Inter- 
rogatives  to  put  together  an  SV-5a! 
And  who  can  clean  their  room  without 
an  OV-1? 


W.:  Sure.  One  day,  we  found  ourselves 
stuck  in  our  two-dimensional 
life.  We  were  arguing 


Eliza:  Yes  ...  er, 
we’ll  get  into 
all  that.  But  let 
me  introduce 
you  to  our  audi¬ 
ence.  This  is  Fred 
deFunk,  his  wife 
Betty,  his 


Eliza:  I’m  sorry— what  are  these  things? 


Fred  An  SV-5a  is  the  Operational  Ac¬ 
tivity  to  Systems  Function  Traceability 
Matrix.  [ELIZA  stares]  You  know,  a 
mapping  of  system  functions  back 
to  operational  activities. 

Betty:  And  an  OV-1  is  The  High- 
Level  Operational  Concept  Graphic! 

Eliza  And  how  did  these  help? 
When  I  was  little,  my  Mom  just 
used  to  say  “Clean  that  dump 
of  a  room  or  else  I’m  gonna 
take  everything  I  find  on  the 
floor  and  burn  it!” 


Fred:  People  say  that  sort 
of  thing  to  us  all  the  time. 
But  they  just  don’t  un¬ 
derstand  that  our  kids  are 
crying  out  for  High-Level 
Data  Constructs! 


Betty:  That’s  right,  Eliza.  We  re¬ 
alized  that  it  was  unfair  to  expect 


IN  TOUCH 


Fred  Jr.  to  transform  inputs  to  outputs 
or  induce  state  changes  without  a  data- 
based  Architectural  Description!  Let  us 
show  you  what  we  mean! 

[They  all  walk  down  to  Fred  Jr.’s  room. 
Inside,  the  room  is  bare  except  for  a 
bed,  a  desk  with  a  laptop  on  it,  and 
a  desk  chair.  The  walls,  however,  are 
covered  with  flow  diagrams.] 

Eliza:  Wow.  This  room  is  ...  clean. 
Where’s  the,  ah,  OV-1  and  SV-5a? 

Fred  Jr.:  Well,  you  silly,  you’re  not 
allowed  to  start  with  that!  Come  over 
here  and  look  at  the  deFunk  DIV-1 ! 

Eliza  [staring  at  a  large  diagram  near 
the  door]:  And  what’s  the  DIV-1  ? 

W.:  Everyone  knows  what  that  is!  It’s 
the  DM2  Conceptional  Data  Model! 
See,  look  at  this.  You’ve  got  Guid¬ 
ance,  made  up  of  Rules,  and  they 
have  Standards  and  Agreements! 

Then  we’ve  got  all  the  Activities— 
and  you  know  those  have  got  to  be 
performable,  or  you’re  just  wasting  or¬ 
ganization  cycles— then  we’ve  got  the 
Capabilities,  and  finally,  the  Resources 
and  Performers! 

Eliza:  And  you’ve  taken  all  the  family 
chores  and  laid  them  out  like  this? 

Betty:  Not  just  chores!  We  do  all  our 
activities  like  this  now! 

Fred:  Including  recreation  [blushing]  — 
but  some  of  those  are  classified. 

Eliza:  Well  what  if  someone  wants  to 
do  something  new  or  different? 

W.:  There’s  nothing  really  new,  be¬ 
cause  we  use  the  IDEAS  Ontology, 
which  separates  Things  into  Indi¬ 
viduals  that  have  4D  spatial-temporal 
extent.  Then  there’s  the  Types,  which 
can  be  classified  using  Naive  Set 


Theory  or  Type  Theory,  and  Ordered- 
Relation  Tuples.  Plus,  we’ve  got  the 
basic  Set  Theoretic,  Mereologic,  and 
4D  Topologic  relationships.  Name  me 
something  that  can’t  fit  into  that! 

Eliza:  Well  ...  I  guess  I  can’t. 

W.:  You  see?  Any  time  anything 
comes  up,  we  take  it  from  Free-text  to 
Structured  Document  to  Database  to 
Mathematically  Structured,  and  we’re 
rolling! 

Fred  And  then  we  can  generate  the 
Meta  Model,  and  start  in  on  the  View¬ 
points! 

Eliza:  Viewpoints?  I’m  getting  the 
impression  there’s  no  room  for  alter¬ 
native  viewpoints. 

Betty:  No,  no,  we’re  not  talking  about 
different  opinions!  We’re  talking  about 
representing  the  capability  as  it  flows 
through  the  deFunk  Enterprise! 

Fred  Jr.:  Yeah,  you  know,  the  Capa¬ 
bility  Viewpoint,  the  Data  and  Infor¬ 
mation  Viewpoint,  the  Operational 
Viewpoint,  the  Project  Viewpoint,  the 
Services  Viewpoint,  the  Standards 
Viewpoint,  and  the  Systems  View¬ 
point!  Me,  I  like  the  Standards  View¬ 
point. 

Eliza:  I’ll  bet  you  can’t  say  all  those  again. 

ALL  [in  unison]:  Capability  Viewpoint, 
the  Data  and  Information  View¬ 
point,  the  Operational  Viewpoint, 
the  Project  Viewpoint,  the  Services 
Viewpoint,  the  Standards  Viewpoint, 
Systems  Viewpoint! 

Eliza:  And  a  Partridge  in  a  Pear  Tree. 
So  ...  tell  me,  was  it  hard  to  make  this 
a  part  of  your  everyday  life? 

Fred  Well,  I’m  a  Chief  Information  Of¬ 
ficer,  so  I  do  this  all  the  time  at  work. 


But  my  family  did  think  it  was  a  bit 
crazy  at  the  start. 

Fred  Jr.:  Yeah,  we  didn’t  believe  Dad 
actually  got  paid  for  this.  We  thought 
he  was  like  the  guy  on  Breaking  Bad, 
who  pretended  to  have  a  job  while  he 
was  making  crystal  meth. 

Betty:  I  became  a  believer  when  I 
started  using  it  down  at  the  bridal 
shop. 

Eliza:  OMG  ...  and  how  do  you  use 
this  there? 

Betty:  Well,  these  days,  we  have 
more  and  more  bridezillas  come  in, 
and  their  mothers— don’t  even  get  me 
started  on  that.  That’s  one  group  that 
the  ontology  probably  can’t  handle. 
But  anyway,  when  I  sit  them  down 
and  make  them  write  out  a  PV-3,  the 
bad  ones  go  out  the  door  and  never 
come  back! 

Eliza  [signaling  to  camera  that  this  is 
about  to  end]:  And  what’s  a  PV-3? 

Betty:  Why,  it’s  a  Project  to  Capabil¬ 
ity  Mapping— a  mapping  of  programs 
and  projects  to  capabilities  to  show 
how  the  specific  projects  and  program 
elements  help  to  achieve  a  capability! 
And  believe  me,  these  girls  nowadays 
have  no  idea  how  to  achieve  a  De¬ 
sired  Effect  under  Specified  Standards 
and  Conditions  through  Combinations 
of  Ways  and  Means  to  perform  a  set 
of  Activities! 

Fred  [beaming]:  That’s  my  wife— she’s  at 
the  top  of  my  little  Meta  Data  Registry! 

Eliza:  And  this  is  Eliza  Faddish,  re¬ 
porting  on  the  deFunks  for  Channel 
2.02.  If  you’re  interested  in  the  deFunk 
approach,  check  out  http://dodcio. 
defense.gov/TodayinCIO/DoDArchi- 
tectureFramework.aspx  today. 
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52nd  Army  Operations  Research  Symposium: 

Analyses  Supporting  a  Leaner,  More 
Capable  Expeditionary  2025  Army 

Holly  Costanzi,  US  Army  Materiel  Systems  Analysis  Activity,  holly.m.costanzi.civ@mail.mil 


The  52nd  Army  Opera¬ 
tions  Research  Sympo¬ 
sium  (AORS),  sponsored 
by  the  US  Army  Materiel 
Systems  Analysis  Activ¬ 
ity  (AMSAA),  was  held 
for  the  first  time  at  the  Commu¬ 
nication-Electronics  Command 
Mallette  Training  Facility  at  Ab¬ 
erdeen  Proving  Ground,  Mary¬ 
land,  on  November  4-5,  2014. 
The  theme  for  the  52nd  AORS, 
“Analyses  Supporting  a  Leaner, 
More  Capable  Expeditionary 
2025  Army,”  reflects  the  impor¬ 
tance  of  analysis  to  enable  the 
Army  to  meet  the  demands  for  a 
leaner,  smarter,  more  lethal,  and 
flexible  Army  while  having  the 
ability  to  operate,  enable  forces, 
and  organize  differently. 

AORS  is  the  preeminent  opera¬ 
tions  research  analysis  profes¬ 
sional  development  event  at 
which  Army  junior  military  and 
civilian  operations  research  ana¬ 


lysts  interact  with  senior  analysts, 
general  officers,  and  members 
of  the  Senior  Executive  Ser¬ 
vice.  The  purpose  is  to  provide 
the  Army’s  internal  analytic  and 
research  organizations  with  the 
opportunity  to  highlight  recent 
analytical  breakthroughs.  The 
conference  provides  a  forum  for 


sharing  information  and  experi¬ 
ence  gained  from  ongoing  and 
recently  completed  operations 
research  projects.  Recent  AORS 
have  focused  heavily  on  analyti¬ 
cal  support  to  deployed  opera¬ 
tional  commander  at  the  tactical, 
operational,  and  strategic  levels. 
The  result  is  a  more  professional 


A  senior  leader  panel  session  was  conducted  at  the  morning  plenary  session  on  November  5 
and  included  Dr.  William  Forrest  Crain,  Director  for  the  Center  for  Army  Analysis,  Ms.  Pamela 
Blechinger,  Director  of  the  US  Army  Training  and  Doctrine  Command  Analysis  Center,  Mr. 
James  Amato,  Director  of  the  US  Army  Materiel  Systems  Analysis  Activity,  and  Mr.  David 
Jimenez,  Director  of  the  US  Army  Evaluation  Center. 
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operations  research  community, 
with  a  greater  appreciation  of 
how  quantitative  analysis  can  be 
used  to  solve  difficult  problems, 
and  a  cohesive  community  that 
can  more  effectively  meet  the 
Army’s  analytic  demands  in  the 
years  to  come.  AORS  consists  of 
two  presentation  formats:  plenary 


sessions  devoted  to  invitational 
presentations  and  concurrent 
working  group  sessions  devoted 
to  technical  presentations.  AORS 
includes  the  presentation  of  the 
Army’s  prestigious  Dr.  Wilbur 
B.  Payne  Memorial  Awards  for 
Excellence  in  Analysis  during  a 
plenary  session,  and  the  Opera¬ 


tions  Research/Systems  Analysis 
(ORSA)  Hall  of  Fame  Banquet, 
which  features  the  induction  of 
historically  distinguished  Army 
operations  research  practitioners 
into  the  ORSA  Hall  of  Fame. 

Mr.  James  Amato,  Director,  AM- 
SAA,  commenced  the  AORS  by 
welcoming  the  Army’s  analysts 
and  noting  that  in  the  history  of 
AORS,  this  was  the  first  time  it 
was  held  at  the  Aberdeen  Proving 
Grounds.  He  emphasized  that  the 
symposium  provides  a  forum  for 
sharing  information  and  experi¬ 
ence,  broadening  the  perspective 
of  the  Army’s  analytical  com¬ 
munity,  and  exposing  analysts  to 
a  variety  of  operations  research 
methods.  COL  Mark  Lukens,  AM- 
SAA’s  Military  Deputy,  served  as 
emcee,  and  welcomed  the  AORS 
distinguished  guests.  In  atten¬ 
dance  were  keynote  speaker  Mr. 
John  Nerger,  Executive  Deputy  of 
the  Commanding  General  (EDCG), 


Mr.  James  Amato,  Director  of  the  US  Army  Materiel  Systems  Analysis  Activity  presents  keynote 
speaker  Mr.  John  Nerger,  Executive  Deputy  to  the  Commanding  General  of  the  US  Army 
Materiel  Command  with  a  coin  and  Certificate  of  Appreciation  at  the  52  nd  Army  Operations 
Research  Symposium  on  November  4, 2014. 
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US  Army  Materiel  Command 
(AMC);  Mr.  Gary  Martin,  Executive 
Deputy  to  the  Command  General 
of  the  US  Army  Communications- 
Electronics  Command,  who 
provided  welcome  comments; 
and  members  of  this  year’s  senior 
leader  discussion  panel:  Dr.  Wil¬ 
liam  Forrest  Crain,  Director,  Cen¬ 
ter  for  Army  Analysis  (CAA),  Ms. 
Pamela  Blechinger,  Director,  US 
Army  Training  and  Doctrine  Com¬ 
mand  Analysis  Center  (TRAC), 

Mr.  James  Amato,  Director, 
AMSAA,  and  Mr.  David  Jimenez, 
Director,  US  Army  Evaluation 
Center  (AEC). 

Other  distinguished  guests  in¬ 
cluded  Mr.  Donald  Tison,  Assis¬ 
tant  Deputy  Chief  of  Staff  (CoS), 
G-8;  Mr.  Robert  Carter,  Executive 
Technical  Director,  US  Army  Test 
and  Evaluation  Command  (ATEC); 
Dr.  Paul  Tanenbaum,  Director, 
Survivability,  Lethality  Director¬ 
ate,  US  Army  Research  Labora¬ 


tory;  Dr.  Garrett  Lambert,  Direc¬ 
tor,  TRAC,  White  Sands  Missile 
Range  (WSMR);  Dr.  Steven  Stod¬ 
dard,  Technical  Director,  CAA;  Dr. 
Paul  Deitz,  Senior  Analyst,  AM¬ 
SAA;  and  Mr.  Phil  DiSalvo,  Acting 
Technical  Director,  AMSAA. 

Mr.  John  Nerger,  EDCG  of  AMC, 
provided  the  AORS  keynote 
speech  during  the  November  4 
plenary  session.  In  keeping  with 
the  theme  of  the  52nd  AORS,  Mr. 
Nerger  spoke  about  today’s  chal¬ 
lenges  with  respect  to  shrinking 
budgets  and  continued  unpre¬ 
dictable  threats.  He  stressed  that 
with  respect  to  the  Army,  analysts 
have  a  mission  that  matters  and 
analysis  is  more  important  now 
than  in  recent  history.  Mr.  Nerger 
concluded  with  his  thoughts  on 
the  Army  profession  and  the  im¬ 
portance  of  civilians,  and  reflect¬ 
ed  on  what  it  takes  for  civilians  to 
be  leaders. 


During  the  plenary  session,  Mr. 
Nerger  presented  the  Wilbur  B. 
Payne  Memorial  Awards  for  Ex¬ 
cellence  in  Analysis.  The  winner 
of  the  Wilbur  B.  Payne  award  is 
decided  by  the  Army’s  Deputy 
CoS,  G-8,  and  is  awarded  in  two 
categories  for  small  and  large 
Army  OR  organizations.  This  year, 
winners  from  2013  and  2014 
were  acknowledged.  For  2014, 
in  addition  to  the  small  and  large 
group  winners,  there  were  pre¬ 
sentations  for  two  additional  cat¬ 
egories,  special  and  assessment. 
Mr.  Nerger  presented  awardees 
with  a  Headquarters  Depart¬ 
ment  of  the  Army  (HQDA)  plaque, 
and  a  certificate  of  achievement 
signed  by  the  Honorable  John  M. 
McHugh,  Secretary  of  the  Army. 

The  2013  small  group  winner  was 
AMSAA  for  its  “Multi-Function 
Electronic  Warfare  Analysis  of 
Alternatives  Performance  and 
Risk  Study.”  This  study  identified 
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and  examined  a  set  of  electronic 
warfare  alternatives  across  six 
system  variants  by  developing  a 
methodology  to  identify  the  key 
technology  drivers  in  the  areas  of 
performance  and  schedule  risk. 
The  effort  provided  critical  input 
that  addressed  the  study  guid¬ 
ance  and  provided  senior  leaders 
the  information  needed  for  a  fully 
informed  acquisition  decision. 

The  201 3  large  group  award  went 
to  the  “Aerial  Reconnaissance  and 
Surveillance  Mix  Study,”  per¬ 
formed  by  the  US  Army  TRADOC 
Analysis  Center.  The  team  devel¬ 
oped  an  Army  aerial  intelligence, 
surveillance,  and  reconnaissance 
resourcing  strategy  to  inform  the 
fiscal  years  2015-2019  Program 
Objective  Memorandum  (POM). 
Their  complex,  innovative  effort 
eclipsed  the  scope  of  all  previous 
analyses  in  this  warfighting  func¬ 
tion  and  provided  the  Army  with 
a  foundation  of  analytic  evidence 


to  underpin  future  Army  resourc¬ 
ing  decisions  regarding  aerial 
platforms  and  associated  sensors. 
The  TRADOC  Analysis  Center, 
TRAC-Ft.  Leavenworth  (FLVN), 
TRAC-WSMR,  AMSAA,  and  the 
Naval  Postgraduate  School  re¬ 
ceived  organizational  and  indi¬ 
vidual  awards. 

The  2014  small  group  award  went 
to  the  US  Army  TRADOC  Analysis 
Center  for  recognition  of  its  work, 
“Army  End  Strength  Analysis— 
Analysis  Supporting  Army  End 
Strength  Reduction  Decisions.” 
The  study  examined  Army  end 
strength  reductions  across  a 
variety  of  conditions  and  potential 
futures.  The  innovative  approach 
enabled  a  robust  examination 
of  options,  risks,  and  costs  that 
supported  an  Army  decision  on 
end  strength,  numbers  of  brigade 
combat  teams,  and  force  com¬ 
position.  This  analysis  provided 
an  objective,  defensible  analytic 


foundation  for  the  Army  to  pre¬ 
serve  its  capabilities  and  meet  the 
nation’s  demands. 

The  US  Army  TRADOC  Analysis 
Center  also  received  the  201 4 
large  group  award  for  its  work, 
“Operational  Energy  Analysis: 

New  Approaches  to  Analyzing 
Sustainment.”  The  team  devel¬ 
oped  an  innovative  approach  to 
analyzing  operational  energy  that 
produced  the  first  credible  and 
robust  analytic  methods  linking 
sustainment  impacts  operational 
outcomes.  This  groundbreaking 
effort  armed  senior  leaders  with 
critical  evidence  supporting  ongo¬ 
ing  Army  modernization  efforts 
in  a  challenging,  resource-con- 
strained  environment. 

Organizational  as  well  as  indi¬ 
vidual  awards  were  received  by 
the  TRADOC  Analysis  Center, 
TRAC-Ft.  Lee,  TRAC-WSMR, 
TRAC-FLVN,  the  TRADOC  Intel- 


ligence  Support  Activity,  and  the 
Logistics  Innovation  Agency. 

The  2014  special  category  award 
was  presented  to  AMSAA  for 
recognition  of  the  work,  “Field 
Deployable  Hydrolysis  System 
(FDHS)  Risk  Reduction  and 
System  Enhancement  Study.” 

The  analysis  directly  shaped 
operational  constraints,  produced 
operator  risk  tables  as  a  function 
of  sea  state  for  FDHS  operation 
by  the  Army  Vessel  Cape  Ray, 
and  made  direct  system  changes 
that  significantly  reduced  risks  to 
operators  and  the  mission.  The 
team  analyzed  critical  system 
attributes  which  resulted  in  a  de¬ 
cision  to  move  forward  with  the 
FDHS.  These  enhancements,  de¬ 
veloped  with  significant  analytical 
rigor,  directly  shaped  operational 
constraints  for  this  critical  proj¬ 
ect,  and  are  now  part  of  FDHS 
system  design  and  operating 
procedures.  Individuals  receiving 


this  award  were  from  AMSAA  and 
the  US  Army  Edgewood  Chemi¬ 
cal  Biological  Center. 

The  CAA  received  the  2014  as¬ 
sessment  category  award  for 
recognition  of  work  on  the  US 
Security  Coordinator  for  Israel 
and  the  Palestinian  Authority  Se¬ 
curity  Forces  Assessment  Study. 
This  study  contributed  directly 
to  the  US  Security  Coordinator 
mission  to  employ  the  correct 
balance  of  quantitative  analysis 
for  a  complex  assessment  of  the 
Palestinian  Authority  Security 
Forces.  The  team’s  work  sup¬ 
ports  and  informs  a  wide  range  of 
US  Security  Coordinator  pro¬ 
cesses  and  decisions. 

Presentations  from  the  HQDA 
Army  Study  Program  Manage¬ 
ment  Office,  the  Functional  Area 
49  Operations  Research/Systems 
Analysis  Proponency  Office,  and 
the  Career  Program  36  Occupa¬ 


tional  Series  1515  Operations  Re¬ 
search  Analyst  Civilian  Manage¬ 
ment  Office  concluded  the  plenary 
session.  The  following  day,  a 
senior  leader  panel  session  ad¬ 
dressing  opportunities  and  chal¬ 
lenges  facing  operations  research 
analysts  along  with  a  question  and 
answer  session,  rounded  out  the 
large  group  sessions. 

The  afternoon  schedule  of  AORS 
on  November  4  and  5  consisted 
of  nine  breakout  sessions:  seven 
permanent  working  groups  fo¬ 
cusing  on  enduring  topics  that 
have  proved  to  be  constant  areas 
of  analysis  focus  over  the  past 
decade,  and  two  topical  work¬ 
ing  groups  that  are  chosen  to 
address  the  most  relevant  and 
time-sensitive  issues  presently 
confronting  Army  analysis.  The 
enduring  working  groups  topics 
are  advances  in  OR  and  technol¬ 
ogy;  current  operations;  force 
development;  future  capabilities; 


On  the  evening  of  November  4,  the  Operations  Research/Systems  Analysis  (ORSA)  Hall  of  Fame  banquet 
was  held  at  the  Richlin  Ballroom.  The  2013  and  201 4  winners  of  this  prestigious  award  were  inducted 
into  the  ORSA  Hall  of  Fame.  Pictured  above  from  the  left  are  GEN  (Ret)  David  M.  Maddox  (2014),  Mr.  E.B. 
Vandiver  (2013),  Dr.  James  Streilein  (2014),  and  Mr.  Michael  F.  Bauman  (2013). 


resource  analysis;  sustainment;  and 
manpower,  personnel,  and  training. 
This  year’s  topical  working  group 
sessions  focused  on  operational 
energy  and  readiness  analysis. 

A  total  of  1 18  OR-related  techni¬ 
cal  papers  were  presented  during 
these  working  group  sessions. 

The  52nd  AORS  included  an 
ORSA  Hall  of  Fame  banquet  on 


the  evening  of  November  4.  Mr. 
Walter  W.  Hollis,  the  former  Deputy 
Undersecretary  of  the  Army  for 
Operations  Research,  chartered  the 
ORSA  Hall  of  Fame  in  March  2004. 
The  ORSA  Hall  of  Fame  honors 
those  individuals  who  have  con¬ 
tributed  significantly  to  US  Army 
operations  research  and  systems 
analysis  over  a  sustained  period  of 
time.  Honorees  have  significantly 


impacted  US  Army  operations 
research  and  systems  analysis 
through  doctrinal  or  technical 
accomplishment  and  innovative  de¬ 
velopment  and  have  demonstrated 
outstanding  personal  leadership 
and  noteworthy  achievements  that 
inspired  others  in  the  field  of  OR. 
The  charter  of  the  ORSA  Hall  of 
Fame  names  the  AMSAA  at  Aber¬ 
deen  Proving  Ground,  Maryland, 
as  its  permanent  location.  The 
ORSA  Hall  of  Fame  is  governed  by 
a  board  of  directors  representing 
the  leadership  of  the  major  analytic 
entities  of  the  Army,  who  each  year 
reviews  the  nominations  and  votes 
to  induct  up  to  two  inductees.  Be¬ 
cause  AORS  was  cancelled  in  201 3 
due  to  sequestration,  this  year’s 
banquet  honored  the  2013  and 
2014  inductees.  The  2013  induct¬ 
ees  were  Mr.  E.B.  Vandiver  III  and 
Mr.  Michael  F.  Bauman.  The  2014 
inductees  were  GEN  (Ret)  David  M,. 
Maddox  and  Dr.  James  Streilein. 
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SomeThouahts  on 

Working  with  the 


International  Community 

Jim  Bexfield,  FS 


his  is  not  an  analytical 
article.  It  does  not 
tell  you  about  a  new 
technique,  inform  you 
of  educational  activities, 
describe  an  event  that 
occurred  in  another  country, 
or  express  a  viewpoint  on 
the  usefulness  of  campaign 
models  to  inform  military 
decisions  (an  area  where 
I  have  strong  views). 
But,  it  does,  I  hope, 
provide  some 
perspectives 
that  will  help 
us  deal  with 


interactions  with  analysts  in  allied 
countries.  Helping  them  build  their 
analytical  base  could  lead  to  better 
decisions  within  their  governments, 
making  all  of  us  safer. 

Over  the  past  few  years  I  have  had 
the  pleasure  of  working  with  the 
international  community  in  many 
different  forums,  ranging  from  leading 
a  major  NATO  activity  with  members 
from  more  than  20  countries  while  still 
in  the  government,  to  twice  teaching  a 
military  modeling  course  in  Singapore 
to  analysts  from  Brunei,  Malaysia,  and 
Singapore,  to  a  project  that  supports  the 
Lebanese  Armed  Forces  in  Beirut.  These 


multiple  languages.  Most  Lebanese 
officers  speak  and  write  Arabic, 
English,  and  French,  and  one  officer 
I  worked  with  speaks  nine  languages 


experiences  have  led  to  some  personal  fluently.  Most  Europeans  and 
observations  that  may  prove  useful  as  Afghans  I  encountered  speak  multiple 
MORS  seeks  to  expand  its  interactions  languages.  They  welcomed  the  praise 
with  the  international  community.  I  provided  regarding  their  ability  to 

speak  multiple  languages,  which 
An  initial  observation  that  strikes  me  helped  build  rapport, 
regarding  military  professionals 

from  other  countries  is  that  Almost  without  exception,  the 

most  of  those  who  do  not  internationals  I’ve  worked  with  were 
have  English  as  their  anxious  to  tell  me  about  their  job, 
native  tongue  culture,  views  of  the  world,  and 

speak  complaints  against  their  government. 
#  Some  had  fought  in  civil  wars,  others 

had  flown  MIGs,  and  still  others 
,  lived  in  a  country 


increasing 


LAST  WORD 


where  they  feel  they  must  go  abroad 
to  have  fun  and  shop  for  nice  things. 
The  legal  systems,  educational 
systems,  traffic,  and  financial  systems 
often  vary  significantly.  When  you 
buy  a  car  in  Singapore  you  pay  a 
tax  equal  to  the  price  of  the  car. 

This  tax  is  good  for  1 0  years  and 
then  must  be  paid  again.  Needless 
to  say,  there  are  few  cars  over  1 0 
years  old  in  Singapore.  In  Lebanon 
you  see  a  lot  of  partially  built  homes 
as  the  homeowner  initially  saves 
enough  to  buy  the  land,  then  a  year 
later  has  saved  enough  to  build  the 
foundation,  and  then,  in  another  year 
added  savings  enable  the  building 
of  the  first  floor.  This  incremental 
approach  continues  until  the  project 
is  completed.  Comprehending  these 
differences  allows  one  to  better 
understand  how  they  communicate 
which,  in  turn,  helps  us  appreciate 


the  points  they  are  making  during  our 
professional  interactions. 

Finally,  most  of  the  internationals  I’ve 
encountered  are  anxious  to  learn  from 
us.  Often  this  learning  best  occurs 
initially  with  oral  communication, 
but  to  ensure  understanding  it  is 
often  best  to  write  down  what  you 
believe  you’ve  heard  and  ask  them 
to  comment.  This  often  results  in 
another  oral  exchange  and  eventually 
a  common  view  of  the  concept.  The 
opposite  works  well,  too,  where  the 
foreign  national  military  professionals 
I’ve  worked  with  write  their  view  of 
the  concept  or  process  and  then  you 
suggest  changes  to  clarify  language. 
In  all  my  interactions  they  have  been 
appreciative  of  well  thought-out 
feedback  that  helps  them  explain  a 
concept  to  their  peers. 
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